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VOR  Calibration  Services 

Neil    T.   Larsen,   Dominic  F.   Vecchia,   George  R.   Sugar 

National    Bureau   of  Standards 
Boulder,   Colorado  80303 


The  National  Bureau  of  Standards  has  designed,  constructed,  and  evaluated  a  standard 
for  the  support  of  very-high-frequency  omnidirectional  range  (VOR)  air  navigation  aids. 
The  standard  consists  of  two  instruments:  (1)  a  digital  waveform  signal  generator  for  the 
composite  VOR  audio  waveform,  and  (2)  a  standard  phasemeter  based  on  time  series  analysis 
of  this  waveform.  Experimental  results,  a  statistical  analysis  of  them,  and  the  principal 
software   listings   are  included. 

Key  Wordsj_    air;   calibration   standard;   navigation;   omnidirectional;    range;   very-high   fre- 
quency;  VOR 

SYSTEM  OVERVIEW 

1.   Introduction 

1.1  History 

The  origins  of  the  air  navigation  system  now  known  as  Very  high  frequency  Omnidirectional  Range 
(VOR)  go  back  to  about  1928,  in  England,  when  work  was  started  on  a  phase-comparison  system.  About 
1940,  the  Civil  Aeronautics  Administration  examined  and  developed  the  technique,  and  finally  presented 
it  to  the  Radio  Technical  Commission  for  Aeronautics  in  1945.  In  1946,  it  was  offered  by  the  U.S. 
Government  to  what  is  now  the  International  Civil  Aviation  Organization  (ICAO).  It  was  accepted  as 
part  of  ICAO's  Standards  and  Recommended  Practices,  where  it  is  stated: 

"In  localities  where  conditions  of  traffic  density  and  low  visibility  necessitate  a  short- 
distance  radio  aid  to  navigation  for  the  efficient  exercise  of  air-traffic  control,  the 
standard  aid  shall  be  VOR  (vhf  omni-range)  of  the  CW  phase-comparison  type  conforming  to 
the  Standards  contained  in  Paragraph  3.4  of  Chapter  III  of  this  Annex  [1]." 

Since  that  time,  more  than  1,000  stations  have  come  into  use  around  the  world.  However,  in  spite 
of  its  use  by  commercial,  military,  and  private  aircraft,  there  has  until  now  been  no  standard  or 
technique  by  which  VOR  instruments  could  be  calibrated,  either  directly  or  indirectly,  at  the  National 
Bureau  of  Standards.  Reference  2  is  a  very  good  overview  of  the  VOR  system.  It  describes  the  origins 
and  evolution  of  the  system  in  considerable  detail  and  is  recommended  to  those  interested  in  the 
history  of  VOR. 

1.2  Organization  of  Report 

This  report  comprises  four  main  parts.  They  are: 

I.  A  general  overview  of  the  VOR  system  and  the  calibration  services  designed  to  support  it  (sec- 
tions 1  through  4). 

II.  A  detailed  description  of  the  NBS  VOR  generator,  including  specifications,  operating  procedures, 
and  theory  of  operation  and  maintenance  (sections  5  through  12). 

III.  A  similar  description  of  the  VOR  phasemeter  (sections  13  through  15). 


IV.  A  statistical  evaluation  of  the  VOR  generator  and  VOR  phasemeter  when  they  are  used  together  as  a 
system  (sections  16  through  18).  A  large  amount  of  both  simulated  and  measured  data  is 
abstracted  and  discussed.  The  statistical  theories  used  in  the  analysis  are  given.  Finally,  a 

provisional  statement  of  uncertainty  is  made. 

The  appendices  provide  graphical  and  tabular  illustrations  of  the  actual  measurement  results. 
The  software  listings  for  the  NBS  phasemeter  and  for  some  of  the  statistical  work  are  included. 
Throughout  this  report,  the  terms  phasemeter  and  generator  appear  many  times.  In  every  case,  a  VOR 
phasemeter  or  a  VOR  generator  is  meant,  but  for  brevity,  the  modifier  will  often  be  omitted. 

Throughout  this  report,  the  terms  phasemeter  and  generator  appear  many  times.  In  every  case,  a 

VOR  phasemeter  or  a  VOR  generator  is  meant,  but  for  brevity,  the  modifier  will  often  be  omitted. 
Areas  where  the  designs  of  the  generator  and  phasemeter  have  influenced  each  other  are  noted.  Since 
there  exists  no  independent  means  of  checking  either  the  phasemeter  or  the  generator,  the  two  must  be 

regarded  as  a  system,  and,  of  necessity,  there  is  a  strong  interdependence  when  it  come  to  the 
evaluation  of  each. 


2.   Technical  Basics 

The  VOR  signal  is  radiated  from  a  transmitter  that  produces  a  spinning  pattern.  The  spin  may  be 
produced  by  a  mechanically  driven  goniometer  or  other  means.  The  antenna  field  pattern  is  not  omni- 
directional; a  contour  of  constant  intensity  follows  a  curve  known  as  a  "limacon."  The  shape  is 
nearly  circular,  as  shown  in  figure  2-1.  As  the  pattern  turns  at  1800  rpm,  the  field  intensity  at  a 
remote  receiver  fluctuates  sinusoidally  at  30  Hz.  The  30  Hz  signal  obtained  by  demodulating  the  VHF 
carrier  is  called  the  "variable  phase"  signal.  If  a  timing  reference  were  available  to  determine  when 
the  peak  of  lobe  passed  magnetic  north,  then  the  phase  of  the  30  Hz  signal  measured  relative  to  that 
reference  would  vary  in  space  as  the  bearing  angle  between  magnetic  north  and  the  receiver,  measured 
at  the  transmitter. 


(I)   0  degrees  rotation      (c)   S0  degrees  rotation     C3)   90  deg'-ees  rotation     C4)   200  dearees  rotation 


Figure  2-1.  The  rotating  VOR  horizontal  field  pattern.  A  dashed  circle  is  shown  for  comparison, 
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Figure  2-2.  Reference  and  variable  phase  signals  as  received  at  three  typical  locations. 


The  required  reference  is  transmitted  by  means  of  a  9960  Hz  subcarrier  that  amplitude  modulates 
the  same  VHF  carrier.  The  9960  Hz  is  frequency  modulated  at  30  Hz.  The  subcarrier  is  obtained  by 
demodulating  the  VHF  carrier,  and  the  30  Hz  "reference  phase"  signal  is  then  extracted  from  the  sub- 
carrier.  The  reference  phase  signal  does  not  change  in  phase  as  the  receiver  moves  in  space.  It  is 
therefore  possible  to  determine  the  bearing  angle  simply  by  measuring  the  phase  angle  between  the  two 
30  Hz  signals.  The  antenna  spin  is  phased  such  that  the  field  intensity  at  a  receiver  due  north  of 
the  transmitter  peaks  at  the  same  time  as  the  30  Hz  reference  phase  signal.  Due  north  corresponds  to 
a  bearing  angle  of  0  degrees. 

Typical  signals  received  at  three  different  locations  are  shown  in  figure  2-2.  Note  that  the 
reference  signal,  derived  from  the  9960  Hz  subcarrier,  is  the  same  at  all  points.  At  point  [1],  the 
variable  phase  signal  lags  the  reference  by  45  degrees,  which  is  also  the  bearing  angle  from  magnetic 
north.  Proportional  phase  lags  are  seen  at  the  other  two  points. 


Figure  2-3  is  a  representation  of  the  audio  signals  from  which  the  bearing  angle  information  is 
obtained.  The  top  waveform  is  one  fundamental  period  of  the  reference  signal.  The  second  waveform 
represents  the  9960  Hz  subcarrier.  Note  that  the  peak  positive  frequency  deviation  occurs  at  the 
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Composite  Rudio  Signal  Cbearing-0  degrees) 


Figure  2-3.  Simulated  30  Hz  and  9960  Hz  waveforms.  Time  is  distorted  for  clarity, 


positive  peak  of  the  reference  signal.  The  sum  of  reference  and  variable  phase  signals  is  known  as 
the  "composite  audio"  signal,  shown  in  the  bottom  curve.  This  is  the  signal  that  is  obtained  at  the 
output  of  the  am  detector  of  a  remote  VHF  receiver.  It  is  the  signal  produced  by  the  NBS  standard 
generator  and  measured  by  the  NBS  standard  phasemeter. 

Note  that  the  time  dimension  in  figure  2-3  has  been  greatly  distorted  to  make  the  frequency  modu- 
lation of  the  subcarrier  visible;  however,  the  phase  relationships  are  correct  for  a  bearing  angle  of 
zero  degrees.  The  figure  is  intended  only  as  an  aid  to  visualization. 

The  composite  signal  shown  above  can  also  be  described  by  a  mathematical  model.  This  model  is 
discussed  in  much  more  detail  beginning  in  section  16.  It  consists  of  two  parts:  the  variable  phase 
waveform  and  the  frequency  modulated  9960  Hz  waveform. 

The  variable  phase  waveform  is 


v(t;_e)  =  a-^    cosC2Trf^t  +  0^  +  62]. 


The  FM  waveform  is 


s{t;_e)   =  a^  cos[2Trf2t   +  63  +   B  sinCZTrf^^t   +  92]]. 

The  composite  waveform  is  defined  by  the  sum  of  these  two  functions.     The   variables   are  as   fol- 
lows: 

t  =  time 

_0  =  a  vector  of  unknown  three  unknown  phase  angles 

ai  =  amplitude  of  variable  phase  signal 

f]^  =  frequency  of  variable  phase  signal  (30  Hz) 

G-j  =  VOR  bearing  angle;  i.e.,  the  quantity  to  be  measured 

82  =  an  arbitrary  phase  offset  included  in  the  model  for  generality 

02  =  amplitude  of  the  FM  subcarrier 

f2  =  frequency  of  the  FM  subcarrier  (9960  Hz) 

Go  =  an  arbitrary  phase  offset  included  in  the  model  for  generality 

B  =  the  modulation  index  of  the  FM  subcarrier  (nominally  =  16) 

It  is  the  purpose  of  the  VOR  generator  to  generate  a  signal  that  conforms  to  this  model,  and  it 
is  the  purpose  of  the  VOR  phasemeter  to  determine  the  actual  value  of  Q-^  ^'''^'^   measurements  on  the  sig- 
nal. The  hardware  aspects  of  the  generation  and  measurement  are  described  at  length  in  sections  4 
through  15;  the  statistical  aspects  of  the  measurement  system  are  covered  in  section  16. 


3.   Description  of  the  VOR  Calibration  Services 

Two  services  are  offered  to  support  the  calibration  of  VOR  instruments.  NBS  has  designed  and 
built  a  standard  VOR  audio  generator,  which  is  used  to  calibrate  unknown  VOR  phasemeters,  and  a  stan- 
dard VOR  phasemeter  for  the  calibration  of  unknown  generators.  Both  of  these  services  are  for  audio 
generators  and  phasemeters;  direct  generation  or  measurement  of  standard  rf  signals  is  not  a  part  of 
this  service,  although  some  effort  is  being  made  in  that  direction.  To  avoid  confusion,  each  of  these 
services  is  discussed  separately. 

3.1  VOR  Phasemeter  Calibration  Service 

An  unknown  phasemeter  is  calibrated  by  connecting  its  input  to  the  output  of  the  NBS  standard 
generator.  The  generator  provides  a  composite  audio  signal  that  is  the  sum  of  two  signals,  each  1  V 
rms  (+1  percent)  in  amplitude.  The  first  is  simply  a  30  Hz  sinusoid,  and  represents  the  variable  phase 
signal  as  it  would  be  recovered  from  the  original  vhf  signal.  The  second  is  the  frequency-modulated 
9960  Hz  subcarrier.  Most  commercial  VOR  phasemeters  cover  the  entire  0°  to  360°  range,  and  so  does 
the  standard.  It  is  possible  to  set  the  standard,  by  means  of  digital  thumbwheel  switches,  to  any 
bearing  angle  from  0°  to  399.99°  in  steps  of  0.01°. 


Calibrations  of  VOR  phasemeters  are  documented  with  a  report  containing  the  following  statement: 

The  assigned  values  o/  VOR  phase  angles  are  the  nominal  bearing  from  0  to  360°  in  inove- 
ments  of  0.01°.  The  overall  uncertainty  of  these  values  has  heen  estimated  from  test  data 
at  hearings  from  0°  to  260°  at  20°  increments.  Thus,  each  of  the  nomi'nal  hearings  has  heen 
assigned  a  provisional  overall  uncertainty  of  +/-  0.0028°,  hased  on  estimated  hounds  of  +/- 
0.0022°  on  the   systematic   error  and  a  computed  standard  error  of  0.0002°. 


It  appears  that  the  NBS  generator  is  more  accurate  than  presently  available  generators  by  about  a 
factor  of  10,  and  better  by  an  even  larger  factor  than  the  needs  of  operational  systems.  It  is  not 
possible  to  fly  an  aircraft,  using  VOR,  to  0.25°,  even  with  an  autopilot.  Ground  effects  perturb  the 
field  of  the  transmitter  enough  that  more  typical  uncertainties  in  the  air  are  on  the  order  of  1°  or 
2°. 

At  present,  the  most  suitable  transfer  standard  appears  to  be  a  commercially  made  phase  meter. 
Neither  the  NBS  generator  nor  phasemeter  are  portable.  Another  possibility  is  a  generator  that  has 
recently  been  developed  at  the  National  Physics  Laboratory,  England,  by  White,  Clark,  and  Yell  [3]. 
We  do  not  yet  know  its  properties,  although  one  intercomparison  with  their  portable  generator  has  been 
made.  There  appear  to  be  no  commercial  generators  that  are  suitable  for  use  as  a  transfer  standard  in 
connection  vyith  the  NBS  standards.  The  problem  is  mainly  with  short-term  jitter  and  noise.  This  may 
change;  however,  any  commercial  phase  meter  used  as  a  transfer  standard  must  demonstrate  shipability. 

3.2  VOR  Generator  Calibration  Service 

An  unknown  generator  is  calibrated  by  the  NBS  standard  phasemeter.  The  output  of  the  generator 
is  connected  to  the  phasemeter.  In  addition,  a  digital  timing  reference  signal  must  be  provided  by 
the  generator  to  the  phasemeter.  Some  commercial  instruments  provide  such  a  signal  internally;  others 
do  not.  Of  those  that  do,  only  two  have  been  found  suitable  for  calibration,  so  far.  This  is  because 
the  operating  principles  of  the  NBS  phase  standard  require  good  short-term  phase  stability  in  the  tim- 
ing signal.  This  is  discussed  further  in  section  13.1. 

Because  of  the  short  term  (30  ys)  phase  jitter  of  most  commercial  generators,  they  cannot  be 
calibrated  by  the  NBS  standard  phasemeter.  Instead,  a  transfer  must  be  made  through  a  commercial 
phasemeter  that  has  been  calibrated  against  the  NBS  standard  generator.  Commercial  phasemeters  do  not 
show  the  sensitivity  to  short  term  fluctuations  that  the  NBS  phasemeter  does.  This  is  usually  due  to 
the  use  of  analog  phase-locked  loops  and  averaging  circuits  that  reduce  sensitivity  to  this  type  of 
noise.  The  price  paid  is  that  the  commercial  phasemeter  is  not  reliable  as  a  primary  standard  and 
must  be  calibrated  against  the  NBS  generator  immediately  before  use  as  a  transfer  standard,  to  mini- 
mize the  degradation  of  the  accuracy  of  the  NBS  generator.  Hopefully,  industry  will  design  stable 
generators  which  provide  a  timing  reference  for  the  NBS  phasemeter. 

Because  of  the  complementary  nature  of  these  two  services  and  the  limitations  of  commercial 
generators,  the  best  transfer  standard  for  either  a  generator  or  a  phasemeter  calibration  is  a  commer- 
cial phasemeter,  as  discussed  in  section  3.1,  above. 

A  sample  report  of  calibration  appears  in  appendix  E. 


4.   Design  Philosophy 

At  the  beginning  of  the  standards  development  effort,  it  was  decided  that  it  would  be  necessary 
to  design  both  a  standard  signal  source  and  a  standard  phasemeter,  since  otherwise  there  would  be  no 
independent  way  of  checking  either  one.  Two  instruments  working  on  different  principles,  that  agree 
closely  with  each  other,  give  some  assurance  that  they  are  both  performing  as  desired.  This  agree- 
ment, of  course,  must  not  require  any  adjustments  or  "twiddling"  of  either  instrument.  This  condition 
has  been  achieved.  In  addition,  other  objective  means  can  be  used  for  evaluating  the  performance  of 
each  instrument  independently  of  the  other,  up  to  a  point.  For  example,  a  common  signal  sampled  by 
the  phasemeter  through  a  single-pole  double  throw  switch  should  result  in  a  zero  phase  difference, 
which  it  does,  to  within  a  standard  deviation  of  less  than  0.0005°.  For  the  generator,  precise  match- 
ing of  differential  time  delays  between  the  various  signals,  extending  through  the  digital-to-analog 
converters  (DACs)  is  possible.  This  is  discussed  in  more  detail  in  section  10.3. 

It  was  also  decided  at  the  outset  that  it  would  be  necessary  to  minimize  the  number  of  linear 
circuit  elements  in  the  signal  paths,  such  as  capacitors,  amplifiers,  resistors,  and  filters.  In 
order  to  attain  the  desired  ±0.01°  uncertainty  objective,  elements  with  significant  time  or  tempera- 
ture drifts  could  not  be  used.  This  requirement  suggested  the  heavy  use  of  digital  circuits.  It 
resulted  in  a  design  in  which  the  remaining  essential  analog  components  have  very  little  effect  on  the 
phase  integrity  of  either  the  generator  or  the  phasemeter  (see  sections  10.3  and  10.4). 

As  above,  the  generator  and  phasemeter  are  discussed  separately. 

4.1  Generator  Design 

The  generator  comprises  three  digital  waveform  synthesizers,  all  driven  by  the  same  crystal - 
controlled  clock.  It  produces  three  digital  outputs,  16  bits  wide,  reset  every  0.01°  (about  925  ns). 
Only  14  bits  of  data  are  actually  generated,  because  of  present  DAC  resolution  and  speed  limitations. 
Binary  numbers  from  -8188  decimal  to  +8188  decimal  are  generated.  This  comprises  16377  different 
codes,  or  2^'*-7.  These  codes  are   used  to  drive  three  13-bit  digital-to-analog  converters  (DACs).  The 
lowest  bit  is  not  used.  The  converters  are  made  as  nearly  identical  as  possible  and  are  designed  in 
such  a  way  that  differential  time  delays  between  them  can  be  made  negligible  (less  than  10  ns).  The 
analog  outputs  represent  the  30  Hz  variable  phase  signal,  the  9960  Hz  subcarrier,  and  the  30  Hz  signal 
that  is,  in  principle,  frequency  modulating  the  subcarrier.  Actually,  there  is  no  frequency  modulator 
in  the  generator,  as  this  would  require  unstable  analog  circuitry.  Instead,  the  subcarrier  is  synthe- 
sized directly  as  the  modulated  waveform.  Note  that  the  subcarrier  waveform  does  not  change  with 
bearing  angle  settings.  The  30  Hz  reference  phase  is  not  needed  in  a  calibration  but  is  useful  for 
other  purposes;  e.g.,  a  30  Hz  phase  angle  standard. 

Normally,  the  composite  audio  signal  used  for  calibrating  phasemeters  is  obtained  by  combining 
the  variable  phase  and  subcarrier  signals  in  a  passive  linear  resistive  adding  network,  which  intro- 
duces insignificant  phase  shifts.  This  network  is  followed  by  a  7-section  linear-phase  LC  filter  with 
a  100  kHz  cutoff  frequency,  to  remove  residual  digital  switching  noise  and  higher  harmonics  present  in 
the  waveform  due  to  the  quantization  in  the  DACs.  The  filter  measurement  and  evaluation  techniques 
are  discussed  in  more  detail  in  section  10.4. 


4.2     Phasemeter  Design 

As  with  the   generator,   analog   circuitry   is   avoided  as  much   as   possible.     The  phasemeter  consists 
of  three  main   elements,    all    of  which   are  commercially   available:      a   16-bit   analog-to-digital    converter 
(ADC),   a  programmable  time  delay   generator   (TDG),    and  a  desktop   computer-controller. 

The  critical    consideration   in  the  phasemeter,   as   in  the   generator,    is   to   avoid  differential    time 
delays   between   the   variable   phase   signal    and  the   reference   phase   signal    present   as   modulation   on   the 
subcarrier.     Most  methods  of  analog  FM  demodulation   cause  unacceptable  instabilities.     More  impor- 
tantly,  they   require  at   least   some  adjustments.     Adjustability  would  defeat  the  objective  of  a  truly 
independent   phasemeter.     A  sampling  technique  provides  a   solution,   since  a  sampling  ADC  gives   constant 
time  offsets,   to  a  first   order  approximation   [4].     The  phase  angle  of  the  variable  phase  signal    rela- 
tive to  the   reference  phase  signal    can  then   be  computed   via  a  fast  Fourier  transform   (FFT). 


VOR  GENERATOR 

5.       Generator  Details 

An   aircraft  determines   its   magnetic  azimuth   relative  to  a  ground-based   VOR  transmitter  by  measur- 
ing the  phase  difference  between  the  two  modulation  components  of  the   received  signal.     The  generator 
described   in  this   report  was   developed  to  serve  as  the  phase  angle   standard  for  these  modulation   com- 
ponents.     It   consists  of  three  separate  audio  generators,   arranged  to  function  with  controllable  phase 
relations   among  them.     There  are  two  30   Hz   sine-wave   generators   and  one  frequency-modulated-wave 
generator.     The  FM  signal    is  a  9960  Hz   carrier,   modulated  by  a  30  Hz  sine  wave  at  a  modulation  index 
of   16.     The  nominal    deviation   is   thus  ±480  Hz. 

The  phase   relation   between  the  two   30   Hz   signals,   which   are  called  the   30  Hz   reference  phase  sig- 
nal   and  the  30  Hz   variable  phase  signal,   can   be  set  for  a   lag  of  0.00°  to  399.99°   in  steps  of  0.01°. 
The  phase  of  the  FM  signal    is   fixed   relative  to  the  30   Hz   reference   signal    such  that  maximum  frequency 
of  the  9960  Hz   signal    occurs   at  the  positive  peak    (90°   point)   of  the  30  Hz   reference  signal    (see  fig. 
5-1). 

The  unique  characteristics   of  the  generator  are   low  distortion   of  the  outputs   and  the  highly 
accurate  control    of  the  phase   relations   among  the  three  signals.     These  features  were  accomplished 
through  the  use  of   synchronous    (clocked)    logic  as   much   as   possible  within  the   instrument.     This   design 
minimized  the   number  of  analog  circuits  used. 

All    three   generators   use  similar  circuits;   they  generate  digital    representations   of  the  desired 
waveforms.     The   output   data   are  then   converted   from  the  periodic   numerical    sequences  to   varying   volt- 
ages which  are  filtered  to  provide  the  desired   sine   and  FM  waveforms.      In  each   generator,   a  new  digi- 
tal   value  is   produced  each  0.925925...   ys   for  every  0.01°  of  a  30  Hz  waveform.     A  13-bit   representa- 
tion  is   used,    giving   a  numerical    resolution   of   almost   1/4096  of  the  peak   value.     An   output   filter 
serves   to   interpolate   between  the  discrete   voltage  steps,   changing  the  stairstep   output   to  a   smoothly 
varying   one. 
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Figure   5-1.     Simplified  block   diagram  of   generator. 

The  general    principle  is   illustrated  in  figure  5-2.     The  output  of  the  counter  changes  each 
0.9259...    ys  and   repeats   after  36,000  counts,   or  1/30  sec.     The  output  of  the  Programmable-Read-Only- 
Memory    (PROM)   changes  accordingly,   and   gives   a   36,000  point  digital    approximation  to  the  desired  wave- 
form.    The  exact  form  is   ideally  a  staircase  with   a  1.08  MHz  step   rate.     This   signal    is   smoothed  with 
a   100  kHz   low-pass   linear-phase  filter  to  achieve  the   required  accuracy.     See  section  10.4  for  a  dis- 
cussion of  the  filter. 


1 . 08  MHz 
Clock 


1   Coun t e  r 

|(Di  V 

i  de  b 

y 

1   36, 

000) 

H 


Read 

On  1  y 

Memo  r y 


Digital- 
Ito-fln  a  1  og 
Con ve  r t e  r 


H 


100    kHz 

Loujp  as  s 

Fi Iter 


SINENflVE 
OUTPUT 


Figure   5-2.     A  waveform  synthesis   technique. 


The  actual  implementation  differs  somewhat  from  the  above  simplified  version,  primarily  to  reduce 
the  cost  of  the  PROM  tables  that  store  the  waveforms.  When  this  design  was  frozen,  the  cost  of  the 
memory  alone  for  a  direct  sine  lookup  table  was  about  $10,000.  Since  then,  there  have  been  large 
reductions  in  the  cost  of  PROMs;  this  factor  should  be  considered  if  this  type  of  instrument  is  built 
again.  Four  techniques  were  used  to  reduce  the  required  memory  size  without  loss  of  accuracy: 

1.  The  symmetry  of  the  desired  waveforms  has  been  used  to  reduce  memory  size  by  a  factor  of  4 
for  the  30  Hz  generators.  Only  one-fourth  of  a  30  Hz  cycle  is  stored;  i.e.,  0°  to  90°. 
These  data  are  used  4  times,  with  appropriate  address  changes,  to  produce  each  30  Hz  cycle. 

2.  In  the  9960  Hz  generator,  one-half  cycle  of  the  desired  waveform  is  stored  and  used  twice  per 
30  Hz  output  cycle. 

3.  Both  30  Hz  generators  share  the  same  PROMs  through  multiplexing.  The  4-phase  clock  permits 
this  approach  without  introducing  phase  offsets. 

4.  The  PROMs  do  not  store  the  actual  waveform  amplitudes;  instead,  they  store  the  second  or 
third  difference  between  each  steps.  With  this  method,  only  two  bits  are  required  for  each 
30  Hz  step,  and  only  4  bits  are  needed  for  each  9960  Hz  step.  Simple  digital  accumulators 
sum  the  successive  incremental  changes  to  obtain  full  14-bit  representations  for  the  DACs 
(only  the  top  13  bits  are  used). 

These  techniques  are,  of  course,  not  free  of  side  costs.  Their  use,  particularly  the  use  of 
incremental  values,  has  added  significant  complexity  to  the  remainder  of  the  circuits.  However,  a 
substantial  net  saving  in  overall  size  and  complexity  has  resulted.  We  now  see  where  further  simpli- 
fication is  possible  and  discuss  this  in  section  12. 


6.   Specifications 

6.1  Audio  Signal  Outputs 

6.1.1  Individual  and  Composite  Signal  Outputs 
Amplitude:  1  V  rms  at  filter  output 

Output  impedance:  600  Q,   unbalanced  to  ground  at  filter  output 

Load  capacitance:  Not  more  than  100  pF;  larger  values  may  cause  nonlinear  phase  shifts. 

6.1.2  30  Hz  Reference  and  Variable  Phase  Outputs  at  Filter  Output 
Purity:  Total  harmonic  distortion  less  than  0.01% 

Noise:  Less  than  0.5  mV  rms  from  0  to  300  kHz 

Phase  lag  setting:  Variable  phase  output  relative  to  reference  phase,  adjustable  from 

0.00  to  399.99°  in  steps  of  0.01°,  lagging. 
Phase  lag  uncertainty:  ±  0.002° 

6.1.3  FM  Output 

Carrier  frequency:  9960  Hz 

Modulating  frequency:  30  Hz 

Modulation  index:   16 

Purity:  The  differences  between  the  measured  and  computed  amplitudes  of  the  various  lines 

in  the  spectrum  are   too  small  to  measure.  Harmonic  distortion  components  were  below  the 

spectrum  analyzer  sensitivity  of  -75  dB. 
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Noise:   Noise,  as  determined  by  measuring  the  amplitude  of  selected  lines,  is  too  small  to 

to  measure  accurately. 
Spectrum:  See  figure  10-1. 

6.2  Other  Outputs 

Synchronizing  Pulses--0°   Reference   (Reference   Phase  [RP]   0°,   Variable  Phase  [VP]   0°,   9960  0  DET) 

Timing:      30  Hz  channels — pulse  occurs  0.00324°    (110  ns)    before  the  positive-going  zero  crossing 

of  the  output   signal.     Note  that  this   time  offset,   which   is   fixed,   does   not  enter  into 

the  phasemeter  uncertainty  estimate,   because  it   affects   all    time  samples   equally. 

FM  channel --pulse  occurs  0.00324°   before  the  positive-going  zero  crossing  at  the  maximum 

positive  frequency  excursion. 
Duration:     0.9   ms 
Amplitude:      Nominal    3  V 
Source  characteristics:     Unloaded  TTL  output  with   100   Q.  series   resistor  added. 

Synchronizing  Pulse--90°   Point  of   30  Hz  Reference  Channel    (RP  90°) 

Timing:     Pulse  occurs   0.00324°    (110  ns)   before  the  90.00°   point   of  the  30  Hz   sine  wave 
Other  characteristics:     As   above 

Master  Clock   Pulse    {<^i) 

Timing:      1.08  MHz   repetition   rate,   4-phase 
Other  characteristics:     As   above 

Square-Wave  Outputs--RP  Cycle,   VP  Cycle,   FM  Scan 

Timing:     30   Hz   square  waves  with   rising  edge  occurring  at  the  fall    of  the  corresponding   0° 

reference  pulse 
Other  characteristics:     As   above 


6.3     Frequency   and  Phase  Stability 
signals   are  derived  from 
Nominal    uncertainty:      1  x  10 


All    signals   are  derived  from  a  single  4.32  MHz  temperature-controlled  quartz  master  oscillator 

-7 


Short  term  stability:  5  x  lO"-'-^  rms 
Aging  rate:  3.5  x  10"°/week 
Output  timing  jitter:  Less  than  ±  1  ns 

6.4  Error  Detection  Circuits 

An  audible  alarm  sounds  when  any  of  the  three  generators  loses  synchronism  with  the  other  two  or 

when  an  erroneous  output  value  is  computed  by  the  digital  circuits.  Indicator  lamps  show  which  error 

condition  has  occurred.  These  comparison  circuits  are  indicated  by  the  circled  letter  "C"  in  figure 
6-1.  All  comparisons  are  made  30  times  per  second. 


11 


30  Hz 

Reference  Phase 

Count e  r 


Phase  L  ag 
Con t  ro 1 


30  Hz 

Var  1  ab 1 e  Ph  as^ 

Coun  ten 


9960  Hz 
FM  Subc  ar  r  1  e 
Counter. 


Ph  ase 
Compe  ns  at o  r 


--____ 

■     30    Hz 
ROM 

^--— 

Doub  1  e 
Re  c  u  mu  1  at  o  r 


Doub  1  e 
flc  c  u  mu  1  at  o  r 


Triple 
flc c umu 1  at o  r 


DRC 


Tl 


1 

-lon 

^ 

LirHw 

' 

Res  1  St  1  \/A 

fldder/ 

DRO^ 

/ 

1 

/ 

/ 

' 

' 

Loui- 

p  ass 

Pi  1 ter 


Compos  i  te 

flud  1  o 

Output 


Figure  5-1.     Error  detection   circuits.     Digital    comparisons   are  made   between  the  pairs   of 
digital    signal    paths   as   indicated   by  the  heavy  arrows.     Clock   is   not   shown. 

6.5  Built-in-Test  Circuits 

5.5.1  Circuit   Tl   in   Figure   5-1 

This   circuit   compares   the  two   30   Hz   generators   at  0  and   360°   phase  lags   and   lights   an  error   lamp 
if  they  disagree.     This  test   is   made  manually   from  the  front   panel. 

6.5.2  Circuit   T2   in   Figure   6-1 

This   circuit   compares   the   FM  generator  with   the  30   Hz   variable   phase   generator  at   90°   phase   lag 
and   indicates   an  error  if  they   disagree.     This  test   is   made  manually,   from  the  front  panel. 

5.6  Controls 

Power  switch. 

Connectors    (5)   to  select  the  components   of  the  composite  signal    and  timing   references 

Phase   lag— 5   decade   lever  switch,   0  to   399.99° 

Error   indicator   reset   pushbutton 

Built-in-test   operate  pushbutton 
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6.7  Indicators 

Power  on:      1   lamp 

Error  indicators:      5  lamps,   1  audible  alarm.      Indicator  latch   ON  if  tripped 

Test   indicators:      2  lamps 

6.8  Other  Characteristics 

Power  input:   117  VAC  ±  10%,  350  W 

Size:  58  cm  high  by  50  cm  wide  by  46  cm  deep 

Ambient  temperature:  Normal  laboratory  environment,  22  ±  5°C 

Signal  connectors:  BNC 


7.   Operating  Procedures 
7.1  Normal  Operation 

Turn  on  ac  power  and  wait  one  hour  for  warmup.  Connect  short  (1  m)  shielded  cables  to  the  30  Hz 
and  9960  Hz  outputs.  Connect  the  two  cables  to  the  resistive  summing  network.  Connect  the  output  of 
the  network  to  the  input  of  the  linear-phase  low-pass  filter.  The  composite  signal  is  then  available 
at  the  filter  output  (see  fig.  7-1).  Set  the  lever  switches  to  the  desired  bearing  angle.  Proceed 
with  measurements.  It  is  normal  for  the  error  alarm  to  sound  briefly  and  for  the  phase  lag  error 
indicator  to  glow  briefly  whenever  the  bearing  angle  switch  setting  is  changed.  There  is  a  problem 
only  if  the  alarm  continues  to  sound.  See  sections  8.5  and  11.3. 
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Figure  7-1.  Connecting  the  standard  VOR  generator,  adder,  and  filter  to  a  unit  under  test, 


7.2  Error  Conditions 

Continuous  sounding  of  the  alarm  after  a  phase  lag  change,  or  momentary  sounding  of  the  alarm  at 
any  other  time  during  operation,  indicates  that  an  error  has  occurred.  The  indicator  lamps  show  which 
circuits  are  involved.  The  RESET  button  turns  off  all  error  indications  but  does  not  affect  any  other 
circuits.  An  automatic  power-on  reset  circuit  clears  all  error  indicators  five  seconds  after  power 
turn  on.  Since  the  generator  circuits  are  self  correcting  (as  described  in  section  8.5),  an  occa- 
sional error  indication  is  of  no  consequence  unless  it  occurs  during  a  measurement.  Any  error  lamp 
that  is  lit  during  a  phasemeter  calibration  means  that  the  run  should  be  repeated,  as  the  data  may  be 
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invalid.  This  is  a  rare  occurrence,  and  is  usually  due  to  a  static  discharge  between  the  operator  and 
the  system.  Frequent  errors  or  a  continuous  alarm  are  reasons  for  concern,  and  their  cause  must  be 
determined  and  corrected. 

7.3  Testing  Bearing  Angle  Settings 

Set  the   bearing   angle   settings   successively  to  0.00°   and   360.00°   and  press   the  TEST  button.     The 
respective   indicator   labeled   0°   or   360°   LAG  should   light.      It   should  not   light   for  other  nearby 
values.      Indications  that  differ  from  these   result   from  faulty   30  Hz  generator  circuits   or  faulty  test 
ci  rcuits. 

Set  the   bearing   angle  to   90.00°   and  press   the  TEST  button.     The  correspondingly   labeled   indicator 
should   light.      It   should   not   light   for  other  nearby   bearing  angle  settings.     Any  other  indication 
shows   a  circuit   failure.     Note  that  the   indicators  will    also   light   for  a  few  settings  well    removed 
from  the  prescribed   settings.     This   condition   is   normal    and   is   of  no  concern. 


8.       Generator 

8.1  General  Approach 

The  overall  design  concept  was  to  reproduce  the  desired  waveforms  from  internally  stored  tables 
of  numbers  which  are  associated  with  the  waveform.  The  last  stage  is  signal  generation  by  means  of  a 
DAC  and  filter.  In  the  actual  implementation,  a  number  of  steps  were  taken  to  reduce  the  required 
amount  of  programmable  read-only  memory,  the  most  expensive  part,  by  a  factor  of  14. 

In  this  section,  the  basic  scheme  is  described  first.  Then,  the  various  techniques  used  to 
reduce  ROM  size  are  discussed. 

It  should  be  noted  that  this  design  does  not  attempt  to  minimize  the  number  of  samples  per  cycle 
required  to  represent  the  required  signals.  The  1.08  MHz  sampling  rate  used  is  well  above  the  Nyquist 
rate  of  about  22000  samples  per  second.  In  fact,  the  design  approach  was  to  use  the  highest  sampling 
rate  that  could  be  readily  implemented,  in  order  to  minimize  the  generation  of  unwanted  signals. 

See  section  12  for  possible  future  improvements. 

8.2  Generating  the  30  Hz  Sine  Waves 
8.2.1  Basic  Method 

The  30  Hz  signals  were  generated  from  stored  numeric  representations  by  fetching  each  successive 

value  from  a  table  and  sending  it  through  digital-to-analog  converters.  In  order  to  get  a  phase  reso- 
lution of  0.01°,  it  was  convenient  to  work  with  36,000  values,  one  for  each  0.01°  of  a  complete  cycle. 
Portions  of  a  sine  table,  based  on  a  full  scale  amplitude  of  ±8188,  are  shown  in  table  8.1. 

It  is  readily  seen  that  the  size  of  such  a  table  can  be  reduced  by  a  factor  of  4  by  using  the 
symmetry  properties  of  the  sine  wave,  as  follows: 
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Table  8.1.  Selected  values  of  8188  sin  e  and  its  first  and  second  differences, 


degrees 


^\ 


0.00 
0.01 
0.02 
0.03 
0.04 
0.05 
0.06 
0.07 
0.08 
0.09 

89.99 
90.00 
90.01 

179.91 
179.92 
179.93 
179.94 
179.95 
179.96 
179.97 
179.98 
179.99 
180.00 
180.01 
180.02 
180.03 
180.04 
180.05 
180.06 
180.07 
180.08 
180.09 

269.99 
270.00 
270.01 

359.91 
359.92 
359.93 
359.94 
359.95 
359.96 
359.97 
359.98 
359.99 


0 

1 

3 

4 

6 

7 

9 

10 

11 

13 

8188 
8188 
8188 

13 

11 

10 

9 

7 

6 

4 

3 

1 

0 

-1 

-3 

-4 

-6 

-7 

-9 

-10 

-11 

-13 

-8188 
-8188 
-8188 

-13 
-11 
-10 
-9 
-7 
-6 
-4 
-3 
-1 


The  table  is  used  directly  for  angles  (6)  between  0°  and  90°.  For  9  between  90°  and  180°,  the 
values  for  (180-9)°  are  used,  scanning  the  table  backward  from  90°  to  0°.  For  angles  between  180°  and 
270°,  the  entry  for  (9-180)°  is  used  but  with  the  sign  of  the  value  changed  to  minus.  For  angles 
between  270°  and  360°,  the  entry  for  (360-9)°  is  used,  again  with  a  negative  sign  for  the  value.  Thus 
the  size  of  the  table  is  reduced  by  4  with  no  loss  of  information. 

The  scanning  of  the  table  is  readily  controlled  with  the  aid  of  a  digital  counter  which  is 
changed  by  one  count  each  0.93  ys  (1/36000  x  1/30  s).  The  count  is  incremented  for  the  first  9000 
counts,  decremented  for  the  next  9000,  then  incremented  for  9000  counts,  then  decremented  for  9000 
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counts  for  four  scans  of  the  PROM.  During  the  second  half  of  this  cycle,  the  sign  of  the  number  is 
negated,  thus  producing  a  normal  sine  wave  output. 

8.2.2  Use  of  Differences  to  Reduce  ROM  Size 

When  the  30  Hz  sine  wave  generators  are  implemented  as  just  described,  the  minimum  size  of  the 
lookup  table  is  9001  13-bit  words.  However,  it  can  be  seen  from  table  8.1  that  the  changes  (the 
"a^^")  between  successive  words  are  small.  If  the  function  is  generated  from  its  stored  differences, 
the  length  of  each  word  in  the  table  is  substantially  reduced.  This  reduction  is  shown  in  table  8.2 
in  the  column  labeled  "First  difference." 


Table  8.2.  Sine  function  and  differences, 


grees 

8188  Sin 

0.00 

0 

0.01 

1 

0.02 

3 

0.03 

4 

0.04 

6 

0.05 

7 

0.06 

9 

0.07 

10 

0.08 

11 

0.09 

13 

First  difference 


Second  difference 


Since  sin{e)  changes  most  rapidly  around  0°,  the  first  differences  at  other  angles  will  not  be  any 
larger  than  those  near  0°.  A  thorough  examination,  in  fact,  shows  that  the  range  of  first  differences 
is  0  to  2  for  9  between  0°  and  90°.  By  using  a  conventional  binary  number  representation,  this  range 
could  be  covered  by  using  two  bits  per  entry,  instead  of  the  13  bits  required  to  represent  8188 
sin(e).  In  the  actual  system,  we  chose  to  carry  this  one  step  further  and  use  second  differences^ 
that  is,  the  differences  between  first  differences.  In  that  case,  the  number  range  is  -1  to  +1.  This 
approach  still  requires  two  bits  to  represent  all  required  values. 

When  differences  are  used  instead  of  the  actual  function,  the  circuits  must  be  modified  to  gener- 
ate the  function  from  the  differences  read  from  the  table.  This  is  done  by  providing  two  accumu- 
lators, as  shown  in  figure  8-1.  The  first  accumulator  adds  the  successive  values  of  A^,  the  second 
differences  read  from  the  table,  and  forms  A^,  the  first  difference.  The  second  accumulator  adds  suc- 
cessive values  of  A^  to  get  the  desired  function,  8188  sin  0,  which  supplies  the  input  to  the  DAC. 
Additional  circuits  are  required  to  insert  the  appropriate  initial  values  into  the  accumulators  at  0° 
and  to  change  from  addition  to  subtraction  when  the  table  is  scanned  in  the  reverse  direction. 

^This  decision  was  made  early  in  the  design  process,  before  it  was  recognized  that  there  is  no  advan- 
tage in  using  second  differences  in  the  30  Hz  generators.   Indeed,  upon  examining  a  complete  computer 
printout  of  the  occurrences  of  all  first  differences,  it  was  discovered  that  the  30  Hz  memory  could 
have  been  cut  in  half  again  by  the  addition  of  a  single  flip-flop.  With  such  an  arrangement,  only  a 
single  bit  is  required  in  the  lookup  table  for  each  value  of  the  sine  function  first  difference.  See 
section  12.1. 
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Figure  8-1.     Overall    generator  block  diagram. 


8.3     Generation  of  the  Frequency-Modulated  9960  Hz  Signal 
8.3.1     Basic  Method 

The  method  used   here  is   similar  to  that  used  for  30  Hz   generation.     The  values   corresponding  to 
the  third  differences  of  the  desired  frequency-modulated  signal,   computed  at   intervals  of  0.93   ys,   are 
stored   in  a  table,    integrated  appropriately,   and   reproduced  through   a  DAC.     The  9960  Hz  generator  is 
driven  from  the  same  clock  as  the  30  Hz  generators;   this   approach  maintains   synchronism  among  all    sig- 
nals.    The  9960  Hz  FM  signal    has   only  a  two-fold  symmetry,   in  contrast  to  the  four-fold  symmetry  of   a 
sine  wave. 

The  function   represented   in  the  table  is 

F(<(>)   =  8188  sin   [332   <}>  +  |^  sin   <}>] 

where   cj)  is  the  phase  of  the  30  Hz  signal    relative  to  its   90°   point.     This   function,  when   interpreted 
as   a  sine  wave  of   slowly  varying  frequency,   sweeps  ±480  Hz  around   9960  Hz.     The  computed   spectrum  is   a 
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Figure  8-2.  Relationship  between  amplitude  distortion  and  phase  uncertainty. 


set  of  discrete  lines  spaced  every  30  Hz  around  9960  (there  is  further  discussion  of  the  spectrum  in 
sections  10.2  and  16.1).  The  -80  dB  points  of  the  spectrum  are  at  ±810  Hz  relative  to  9960  Hz.  This 
means  that  almost  all  of  the  information  contained  in  the  composite  VOR  signal  appears  in  the  line  at 
30  Hz  and  the  band  between  9150  and  10770  Hz.  For  purposes  of  the  standard  generator  and  the  standard 
phasemeter,  it  can  be  shown  [5]  that  sufficient  information  to  perform  a  calibration  to  an  uncertainty 
of  less  than  0.01°  can  be  obtained  from  the  30  Hz  line  and  those  between  9420  Hz  and  10,500  Hz. 

The  PROM  table  stores  half  of  this  FM  waveform,  using  18000  locations  to  do  so.  The  other  half 
is  obtained  by  reading  the  table  backwards. 

8.3.2  Use  of  Differences  to  Reduce  PROM  Size 

As  in  the  case  of  30  Hz  signal  generation,  a  table  storing  the  function  F(((>)  would  be  quite 

large,  18001  13-bit  words.  Again,  because  the  function  changes  relatively  little  between  successive 

entries  in  the  table,  it  is  feasible  to  use  differences  to  reduce  the  required  word  length.  The  use 

of  third  differences  reduces  the  word  length  to  4  bits,  as  indicated  in  table  8.3. 
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Table  8.3.  9960  Hz  FM  signal  function  and  its  first  three  differences. 

(j)                  First  diff.       Second  diff.  Third  diff. 

Degrees       F(<|))         (a^            (a^)  (a^) 

-2  -1 

-3  -3 

-6  -1 

-7  -3 

-10  0 

-10  -2 

-12 


8  -2 

6  0 

6  -1 

5  -3 

2  -1 


0.00 

0 

497 

0.01 

497 

495 

0.02 

992 

492 

0.03 

1484 

486 

0.04 

1970 

479 

0.05 

2449 

469 

0.06 

2918 

459 

0.07 

3377 

447 

179.93 

-3083 

423 

179.91 

-2660 

431 

179.95 

-2229 

437 

179.96 

-1792 

443 

179.98 

-1349 

448 

179.99 

-451 

451 

180.00 

0 

— 

There  is  a  priori  reason  to  assume  that  the  higher  order  differences  will  have  numerically 
smaller  values.  The  design  approach  was  to  select  the  lowest  order  differences  that  had  reasonably 
small  absolute  values.  Table  8.4  shows  that  for  F((t)),  the  maximum  magnitude  of  the  differences 
decreases  up  to  a^  but  then  increases  again.  Accordingly,  A^  was  chosen  as  the  function  to  be  stored 
in  the  table.  This  optimum  approach  was  ascertained  by  a  computer  algorithm  that  tested  the  zero 
through  fifth  differences. 


Table  8.4.  Maximum  value  of  the  first  through  fourth  differences  for  the  9960  Hz  FM  waveform. 

First  difference:  \a^\  <  496 

Second  difference:  JA^j  <  31 

Third  difference:  I'^^l  ^  ^ 

Fourth  difference:  Ia'*!  <  7 


The  circuit  arrangement  required  to  implement  this  approach  is  also  shown  in  figure  8-1.  Three 
digital  accumulators  are  required  to  determine  the  values  of  A^  from  A^,  a^  from  A^  and  F(<f))  from  A^. 
The  accumulators  are  initialized  to  correspond  to  the  values  given  in  table  8.3  for  (j)  =  0.00°,  namely 
F(O.OO)  =  0,  aI(O.OO)  =  497,  and  a2(0.00)  =  -2  since  this  information  is  not  stored  in  the  PROM.  A 
similar  initialization,  but  with  different  numeric  values,  is  also  used  at  180.00°. 

8.4  Accuracy  Considerations 

The  general  design  goal  has  been  to  achieve  an  overall  uncertainty  of  ±0.01°  in  the  various  out- 
puts of  the  signal  source.  This  goal  affects  the  design  in  three  critical  areas: 
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a.  The  short-  and  long-term  accuracy  of  the  output   frequencies; 

b.  the   short-  and  long-term  accuracy  of  the  phase  differences   between  the  three   output   signals; 
and 

c.  distortion   and  noise   at  the  three  signal  outputs. 

8.4.1  Frequency   Accuracy 

All    outputs   are  derived   from  a  single  4.32  MHz  quartz  crystal    oscillator  with   an  aging   rate  of 

less  than  3.5  x  10"°/week.  and  a  short-term  stability  of  5  x  lO"-'-^  rms.  After  allowing  for  temperature 
and  voltage  effects,  the  estimated  frequency  accuracy  is  about  1  x  10"  .  The  frequency  error  required 
to  produce  0.01°  error  would  be  1/36000  or  2.8  x  10"^.  Thus,  errors  from  the  crystal  oscillator  fre- 
quency instability  should  not  exceed  (0.01)  (10"'')/(2.8  x  IQ-^)  or  0.000035°,  a  clearly  negligible 
amount.  This  oscillator,  and  that  in  the  phasemeter  time-delay  generator,  are  conveniently  calibrated 
directly  against  the  NBS  atomic  clock.  Routine  calibrations  have  resulted  in  corrections  of  less  than 
5  X   10"^°,   which   is   still    negligible. 

The   second   potentially   significant   source   of  uncertainty   is   the   short-term  variations   in  timing 
of  the  circuits   that  use  the  clock   signals.     The  system  design   uses   synchronous   logic  so  that   varia- 
tions  in  time  delays  will    accumulate  over  only  a  few  logic  elements.     The  short-term  variations   in 
delay  through  the  critical    path   from  the  clock  oscillator  to  the  inputs   of  the  digital-to-analog  con- 
verter are   less   than   5  ns    (54  microdegrees) .     This   is  well    below  the  926  ns   clock  period  and  therefore 
could   contribute  at  most  a   negligible  uncertainty. 

8.4.2  Phase  Setting  Accuracy 

The  desired  phase  shifts  between  the  various  outputs  are  produced  by  delaying  the  30  Hz  variable 
phase  generator  in  increments  of  the  clock  period,  926  ns.  At  any  delay  setting,  the  actual  delays 
have  a  variation  of  less  than  5  ns,  a  negligible  amount.  The  clock  signals  are  distributed  in  a 
manner  which  ensures  that  significant  fixed  differential  delays  are  not  present.  Residual  delays  that 
appear  at  the  analog  outputs  are  reduced  to  less  than  5  ns,  as  noted  below. 

The  composite  signal  is  obtained  by  adding  the  9960  Hz  FM  and  30  Hz  variable  phase  signals  in  a 
passive  resistive  network.  A  passive  low-pass  filter  follows  the  adding  network.  The  filter  has  a 
cutoff  frequency  of  100  kHz,  well  below  the  1.08  MHz  clock  frequency.  It  has  a  Bessel  (maximally 
linear  phase)  response  and  contains  seven  sections.  It  is  designed  to  work  between  500  n   source  and 
load  impedances  and  is  terminated  by  a  600  9.   load.  This  design  provides  a  fixed  output  level  of  1  V 
rms  for  each  of  the  two  components  of  the  composite  signal.  It  was  found  that  most  commercially 
available  600  fi  "T-pad"  attenuators  were  not  sufficiently  phase  linear  to  provide  for  an  adjustable 
output.  Such  an  attenuator  could  be  added  at  the  price  of  a  slight  increase  in  the  phase  uncertainty. 

A  Bessel  filter  with  seven  sections  closely  approximates  the  ideal.  In  such  a  filter,  the  time 
delay  (phase  shift  divided  by  frequency)  is  nearly  the  same  for  all  frequencies.  This  is  another  way 
of  stating  that  the  filter  has  low  group-delay  distortion.  Obviously,  if  all  of  the  significant  com- 
ponents of  the  spectrum  are  equally  delayed  in  time,  there  is  no  effect  on  the  VOR  bearing  angle. 
Computer  simulations  of  the  effects  of  the  actual  filter,  with  its  measured  imperfections,  have  shown 
that  the  differential  time  delays  from  30  Hz  to  10,770  Hz  (a  band  that  includes  virtually  all  of  the 
composite  signal  power)  are  negligible  in  so  far  as  the  bearing  angle  is  affected.  See  section  10.4 
for  measurement  details. 
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A  third  potential    source  of  uncertainty   in  the  bearing  angle   is  the   instability   of  the  filter 
characteristics   due  to  component  drift.     The  filter  is   passive,   with   no  operational    amplifiers. 
Bessel    filters  tend  to  have  a  low  sensitivity  to  component  drift;   inductor   "Q"s   for  a  7-section   filter 
need  not  exceed  about   1.1.     Finally,   since  the  first-order  errors   have  been   found   negligible,   certain- 
ly higher-order  errors   are  also. 

8.4.3     Amplitude  Distortion  and   Noise 

Noise  and  distortion   are   introduced   into  the  output  signals   in  a  number  of  ways.     These  include 
quantizing  noise,   digital-to-analog  converter  nonlinearity,   switching  spikes    (so-called   glitches), 
nonlinearity   in  the  amplifiers  that   follow  the  converters,   and  digital    signals  that   find  their  way 
into  the  analog  signal    outputs  through   subtle  paths.     All    of  these  have  an  explicit  effect  on  the 
design   of  the  system.     All    are  discussed  below. 

8.4.3.1  Quantizing  Noise 

The  unfiltered  output   from  the  digital-to-analog  converter  is   nominally   in  the  form  of  a  stair- 
case with  a  step   size  equal   to  2"'^  times  the  peak-to-peak  output   voltage,   where  N  is  the  number  of 
bits   used  in  the  converter.     This  means  that  the  maximum  uncertainty   in   reproducing  any  waveform  will 
be   1/2  the  step  size.      In  terms   of  the  peak   value  of  a  sine  wave  with   unit   amplitude,   the  maximum 
uncertainty   is   l/(2'^-l). 

A  useful    interpretation  of  the  0.01°   uncertainty   requirement   is  that  amplitude  distortion   of  a 
signal   must   not   shift  the  time  position  of  a  zero  crossing,   with   respect  to  an   ideal    30  Hz  sinusoid, 
by  more  than  0.01°.     The  amount   of  distortion  that   produces   this   phase  shift   is   easily  deduced   from 
the  phasor  diagram  of  figure  8-2. 

The  maximum  value  of  Ae  is   related  to   aE  by  the  expression   aE  =  A  sin(A9).     Thus,   for   AG  =  0.01°, 
aE/A  =  sin(O.Ol)   =   1.7  x   lO"'^.     Thus,   0.017  percent   is  the  maximum  allowable  distortion   for  a  phase 
uncertainty  of  ±0.01°. 

Setting   2"'^  =  0.017   percent,   we  obtain   N  >  13.      If  quantizing  noise  in   one  channel   were  the  only 
source  of  error,   a   13-bit  converter  would  be  adequate.     However,   since  there  are  other  sources   of 
error,   a  more  conservative  design  must   be  used.     Converters  that  will    operate  at  the   required   speed 
are  not   readily  available  for  N  >   13.     Accordingly,    13-bit  converters   are  used,   followed   by  a   low-pass 
filter  to   further   reduce  the  quantizing   noise.     Assuming  that  the  principal    quantizing  noise  component 
is   at   1.08  MHz,   a  7-section  Bessel    low-pass  filter  with  a  cutoff  frequency   at   100  kHz  will    reduce  this 
noise  component   by  more  than  80  dB.     The  quantizing  noise   from  a  13-bit   converter  followed  by  this 
filter  should  then   be  1.2  x   10"°  percent.     Note  that  the  total    harmonic  distortion   figures   given  above 
Include  the  effects   of  quantizing  noise,   along  with  other  noise  sources,   hum,   and   harmonic  distortion. 
It   is   apparent  that  the  quantizing  noise  is   very  small    compared  to  the  maximum  allowable   value  of 
0.017  percent,   and   in  fact   is  too  small   to  be  measured. 

8.4.3.2  Converter  Nonlinearity 

The  DACs  used  have  a  specified  maximum  nonlinearity  of  ±1/2  of  the  least  significant  bit  (LSB) 
relative  to  a  straight  line  connecting  the  largest  and  smallest  output  values.  Thus,  the  amplitude 
uncertainty  at   a  nominal    zero-crossing  point  could  be  as   great  as   1/2   LSB,   or  6.1   x  10"^.     The  change 
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in  the   zero-crossing  time  that  this   uncertainty  v/ould   produce   can   be  estimated   by   assuming  that  the 
slope  of  the  waveform  is   constant   in   this    region   and  equal   to   Z-n-f   for  a  unit   amplitude  sinusoid. 
There,   the   offset   At   for   an   amplitude   uncertainty   of   Av   is   given   by 

At   .^.   6.1   X   10-5  ^   ^^^^^   ^^^ 
2^f  2^    .   30 

or 

0.324    us 


=   0.0035   deg. 

0.925   uS   per  0.01   deg 

This    result,   taken   alone,    indicates   a  marginal    design.     However,   the  uncertainties   caused  by  converter 
nonlinearity   are   only   significant   to  the   extent  that   the   resulting   distortion   components   appear  at  the 
output   of  tne   filter  described   above.     All    three   converters   are   interchangeable.     The  harmonic  distor- 
tion  for  all    three  v/as  measured  at   30  Hz,   at  the  filter  output,   using  a  twin-T  notch  filter  with  a 
fundamental    rejection   of  more  than   100  dB   at   30   Hz.     This   technique  allowed  direct  measurement  of  the 
total    noise   and  distortion   products   of  the   DACs.      In   all    cases,   the  total    was   less  than  the  fundamen- 
tal   by  more  than  85  dB. 

8.4.3.3  Converter   Svn'tching   Spikes 

Switching  spikes    (or   "glitches")   occur  in   digital-to-analog  converters   because  of  small    differen- 
tial   delays   in  the  digital    input   signals   for  different   bits.     The   glitches   are   always   present  to  some 
degree,    because  the   current    switches   turn   on   in   less   time  than  they  turn   off.     The  converters   used   in 
the   VOR   generator  are   "de-gl itched;"   that   is,   they   contain   circuits  that   prevent  the   glitches  from 
reaching  the  analog  output.     Tnis   is   accomplished  by  following  the  digital    portion  with  a  track-and- 
hold   amplifier  and   providing   appropriate  timing   signals.     The   amplifier  is   in  the   "hold"   mode  while 
tne  digital    currents   settle,    and   is   tnen   switched  to   "track"   until   just  before  the  next  digital   word 
arrives.     This  technique  significantly   reduces  the  spike  energy. 

8.4.3.4  Amplifier   '^oise   and   Nonlinearity 

Tne   current-to-voltage   output   amplifiers   in   the  converters   were   supplied   by  the  manufacturer. 
The   Characteristics   of  these  amplifiers   are  included  in  the  total    specifications   of  the   converters. 

Actual    performance  was   determined   oy   ine  total    harmonic   distortion   measurements. 

8.5     Error-Detection   and   Built-in-Test   Circuits 

8.5.1     Overview 

In   order  to  maintain   this    system  as   a   national    standard,    it   is   essential    to   provide   a  means   of 
routinely   checking  for   slight   degradations   in   its   performance.     Major  failures  will    be  immediately 
obvious  when   attempting  to   use  the  system.      However,   minor  malfunctions,   such   as   a  single   bit   changing 
in  ROM,   might   never  be  detected  without   repeating  the   full    system  validation.     Therefore,   the  digital 
subsystems   were  designed  to   include   error-detecting   circuits,    as   described   in   section   5.4.      It  was 
relatively   simple  to   augment  this   inherent   capability   and   provide  the   ability  to   detect  a   large 
variety   of   permanent   or  transient   malfunctions   in   the   digital    circuitry.     Two  types   of  checking   are 
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provided.     The  circuits  which  function  without   special    attention   from  the  user  are  called  error-detec- 
tion circuits.     Those  that   require  operator  manipulation  are  called  built-in-test   circuits    (see 
fig.   6-1). 

8.5.2  Inherent  Error-Detecting  Capabilities 

Using  the  method  of  differences  to  generate  the  output  functions  provides  an  inherent  capability 
for  error  detection.  Any  single  error  in  the  ROM  output  data  or  in  any  accumulator  will  continue  to 
distort  the  output  signal  until  the  start  of  a  new  cycle.  When  this  occurs  in  other  than  the  final 
accumulator  (the  "f-accumulator"),  the  distortion  increases  continually  throughout  the  cycle.  The 
result  is  that  consistent  single  errors  are  likely  to  produce  a  severe  distortion  of  the  output  sig- 
nal. This  distortion  results  in  a  major  degradation  of  performance  and  would  probably  be  noticed 
immediately  by  the  user.  It  is  immediately  apparent  on  an  oscilloscope.  However,  errors  that  occur 
close  to  the  end  of  a  cycle  may  not  produce  enough  distortion  to  be  obvious  to  the  user. 

8.5.3  Error-Detection  Circuits 

Three  error-detection  circuits,  one  for  each  of  the  three  channels,  provide  a  continuous  check  on 
the  internal  functioning  of  the  digital  elements  of  each  channel.  They  operate  by  verifying  that  the 
outputs  of  the  30  Hz  channels  are  correct  at  their  359.99°  points  and  that  the  9960  Hz  channel  output 
is  correct  just  preceding  its  0°  and  180°  points.  Two  additional  error-detection  circuits  check  the 
9960  Hz  counter  and  the  30  Hz  phase-lag  counter,  at  times  just  prior  to  their  initialization,  to 
ascertain  whether  a  miscount  occurred  during  the  current  cycle  (see  fig.  6-1).  The  five  self  checks 
are  denoted  by  the  letter  "C"  and  the  two  tests  by  "T".  When  an  error  is  detected  by  any  of  the  five 
"C"  circuits,  an  indicator  lights,  and  an  alarm  sounds  briefly.  The  phase-lag-counter  error  light 
automatically  resets  after  1/10  s,  since  this  error  occurs  each  time  the  phase-lag  setting  is  changed 
by  the  user.  The  other  four  error  indicators  must  be  reset  manually.  This  arrangement  allows  an 
extended  measurement  to  be  made  without  an  operator  present;  if  one  or  more  of  these  lights  is  on  at 
the  end  of  the  measurement,  it  must  be  assumed  that  bad  data  may  have  been  taken.  Over  a  period  of 
several  months  of  use,  the  only  times  that  these  lights  have  been  lit  have  been  when  static  discharges 
have  taken  place  either  nearby  or  into  the  instrument  itself.  There  have  been  no  "hard"  failures.  A 
power-on  reset  circuit  resets  all  indicators  5  s  after  power  is  first  applied. 

8.5.4  Built-in-Test  Circuits 

These  circuits    (described   in   section   6.5)   compare  time  delays   introduced  by  the  phase-lag  cir- 
cuits with  fixed  delays   in  the  generator  control    circuits,   thus  providing  a  means  of  cross-checking 
the  various  digital    delays.     Checks   are  performed  at  0°,   90°,   and   360°   lags.      In  operation,   the  tests 
are  performed  by  setting  the  phase-lag  switch  to  one  of  these  three  lags   and  seeing   if  the  appropriate 
indicator  lamp   lights  when  the  TEST  push-button   is  depressed. 


9.       Power  Supplies 

The  digital    logic  that   generates  the  data  presented  to  the  digital-to-analog  converters   is 
powered   by  a  single  5  V,   16  A  supply.     The  nominal    drain   is   12.5  A.     The   logic  is   protected  by  a  6.8  V 
crowbar  circuit.     Heavy  copper  distribution   buses   and   remote  sensing  are  used. 
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Each  of  the  three  analog  channels  has  its  own  power  supplies,  to  reduce  the  possibility  of  cross- 
talk that  could  contaminate  the  output  signal.  Each  channel  uses  a  plus  and  minus  15  V,  350  mA  supply 
for  the  analog  circuits  and  a  5  V,  500  mA  supply  for  the  DAC  logic. 


10.  Verification  of  Performance 

In  this  section,  we  discuss  the  methods  that  verify  that  the  digital  and  analog  circuits  are,  in 
fact,  performing  as  intended. 

10.1  Memory  Pattern  Verification 

The  VOR  "standard,"  in  a  certain  sense,  exists  in  the  bit  pattern  of  the  programmable  read-only 
memory  chips.  Therefore,  considerable  attention  was  given  to  assuring  that  the  patterns  were  correct. 
This  was  done  as  follows: 

1.  A  BASIC  program  was  written  for  a  desktop  computer  to  prepare  magnetic  tapes  containing  the 
binary  values  for  all  of  the  PROM  addresses  for  both  the  30  Hz  and  9960  Hz  memories. 

2.  A  second  program  was  written  to  read  the  binary  patterns  from  the  magnetic  tapes  to  a  paper  tape 
punch.  The  PROM  vendor  required  such  tapes  to  perform  the  programming  operations.  The  PROMs  are 
of  the  fusible-link  type,  nonerasable.  This  choice  was  dictated  by  the  speed  requirements. 

3.  A  third  program  was  written  to  read  back  the  paper  tape  and  compare  the  punched  pattern  with  the 
original  magnetic  record.  Punching  errors  were  found  and  corrected. 

4.  A  test  jig  and  interface  was  designed  and  a  program  written  to  read  the  programmed  PROM  patterns 
and  compare  them  directly  with  the  original  magnetic  tape.  Programming  errors  were  corrected; 
defective  PROMS  were  replaced  by  the  vendor. 

5.  The  PROMS  were  installed  in  the  generator,  and  a  special  interface  was  designed  to  allow  the 
computer  to  drive  the  system  in  place  of  the  normal  system  clock.  Programs  were  written  to  allow 
rapid  access  to  any  part  of  the  waveform  cycle  (36,000  PROM  addresses).  This  allowed  examination 
of  the  bit  patterns  in  the  three  channels  at  such  critical  points  as  sign  changes,  memory  address 
turnaround,  and  so  forth.  Memory  could  be  stepped  one  address  at  a  time  for  debugging. 

6.  When  all  appeared  normal,  a  program  was  written  to  step  the  logic  through  all  36,000  addresses 
and  read  out  to  the  computer  all  three  16-bit  words  appearing  at  the  DAC  inputs.  These  were 
compared  with  the  proper  words  computed  at  the  same  time,  rather  than  comparing  with  the  magnetic 
tape,  so  that  the  patterns  were  compared  directly  with  the  algorithm  that  generated  them  in  the 
first  place.  This  test,  which  involved  the  computation  and  comparison  of  108,000  16-bit  words, 
required  about  10.5  hours  to  run.  This  may  be  compared  with  the  time  required  for  the  generator 
to  produce  them  normally,  that  is,  about  33  milliseconds.  No  discrepancies  were  found,  and  it 
was  concluded  that  the  digital  portion  of  the  generator  was  indeed  performing  as  required. 

7.  Two  other  points  were  considered  in  this  verification.  First,  the  question  of  whether  the 
computer  used  to  generate  the  PROM  patterns  had  sufficient  precision  was  answered  by  generating 
the  same  patterns  using  a  large  digital  computer  capable  of  maintaining  24  decimal  digit 
precision.  The  files  were  identical,  which  is  not  surprising,  since  the  small  computer  was 
capable  of  12  decimal  digit  precision.  Second,  the  algorithm  used  to  generate  the  data  was 
derived  independently  by  several  persons,  to  ensure  that  it  accurately  represented  the  VOR 
waveform. 
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Figure   lU-1.     Partial    9960  Hz  spectrum.     Arrows   indicate  computed  amplitude. 

10.2     Analog  Performance  Verification 

Some  discussion  of  the  methods   used  to  verify  the  analog  performance  was   given   in  section  8.     For 
completeness,   this  discussion  will    be  expanded  here. 

Initially,   until    the  completion   of  the  phasemeter,   it  was   not   possible  to  make  an  overall    test  of 
the   generator.     However,   the  individual    components   of  the  analog  circuits  were  tested.     Each  of  the 
DACs,   in  turn,  was   driven  by  the  digital    data   from  the  9960  Hz  data   lines.     The  output  of  each   DAC  was 
examined  with  a  spectrum  analyzer.     Figure   10-1   is  a  typical    result.     Plots  were  made  that   showed  that 
the  spectra  of  the  output  were   in  close  agreement  with  the  theoretical    and  that   harmonic  components 
were  below  the  minimum  detectable  level    (about  -70  dBc  for  the  FM  waveform).     Errors   such  as  missing 
codes   in  the  DACs,   or  excessive  non-monotonicity,   show  as   unwanted   sidebands.     The  outputs  were  also 
examined  across   an  entire  cycle,   using  an  oscilloscope  with  an  expanded  sweep,  to  ensure  that  the  DAC 
deglitching  circuits  were  performing  properly. 

A  second  set   of  tests  was  made  on  each   DAC  using  the  digital    input  from  the  30  Hz   reference  phase 
generator.     Since  the  analog  output  contained  only  a  single  frequency,   it  was  possible  to  measure  har- 
monic distortion   directly   by   suppressing  the  fundamental.      It  was   at   least  85  dB  below  the  funda- 
mental . 
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Finally,  the  analog  filter  was  tested  to  the  extent  possible  before  the  completion  of  the  phase- 
meter.   In  the  end,  the  definitive  tests  on  the  filter  were  made  with  the  help  of  the  phasemeter,  as 
described  in  section  10.4. 

10.3  Di gital -to-Analog  Circuit  Timing  Verification 

Ideally,  there  would  be  zero  differential  time  delay  and  jitter  between  the  three  analog  signals 
at  the  outputs  of  the  DACs.  The  three  DACs  are  nominally  identical,  and  all  are  clocked  by  the  same 
clock  phase.  They  are  provided  with  two  timing  adjustments  each.  Data  is  presented  to  each  DAC  on 
the  falling  edge  of  clock  phase  1.  When  the  clock  falls,  the  first  of  two  cascaded  monostable  multi- 
vibrators is  triggered.  The  time  delay  to  its  falling  edge  is  adjustable  over  a  small  range.  Its 
falling  edge,  in  turn,  triggers  the  second  monostable,  which  produces  a  pulse  with  a  fixed  50  ns 
width.  During  the  period  of  the  first  delay,  the  digital  data  settle  at  the  DAC  input.  The  rising 
edge  of  the  second  delay  enables  the  DAC,  and  the  data  are  latched  into  the  DAC  registers.  At  the 
same  time,  the  DAC  deglitching  amplifier  is  placed  in  the  "hold"  mode,  so  that  the  DAC  switching 
impulses  do  not  reach  the  output. 

The  DAC  contains  a  second  adjustable  delay  internally,  that  determines  when  the  deglitching 
amplifier  is  returned  to  the  "track"  mode.  This  adjustment  allows  optimization  of  the  DAC  speed  while 
allowing  switching  transients  to  die  out.  To  match  the  three  DAC  time  delays,  each,  in  turn,  was 
driven  by  the  9960  Hz  data.  Since  there  are  only,  on  the  average,  about  108  samples  per  cycle  in  this 
waveform,  the  transitions  may  be  clearly  seen  on  an  oscilloscope.   If  the  oscilloscope  is  triggered  by 
the  transition  of  the  sign  bit  of  the  reference  30  Hz  DAC,  at  a  sweep  speed  of  20  ns/division,  all  of 
the  DACs  may  be  adjusted  to  equality  to  within  10  ns  or  less.  The  delay  from  the  falling  edge  of 
clock  phase  1  to  the  rising  edge  of  the  DAC  enable  pulse  was  set  to  110  ±  2  ns.  Then,  the  delay  from 
the  falling  edge  of  the  clock  to  the  beginning  of  the  analog  output  transition  was  set  to  300  ±  5  ns. 
A  mismatch  of  7  ns  corresponds  to  a  phase  uncertainty  of  about  76  microdegrees,  a  negligible  amount. 

10.4  Analog  Filter  Characteristics 

The  actual  characteristics  of  the  output  filter  were  measured  as  follows.  A  single-pole  double- 
throw  reed  relay  was  placed  at  the  input  to  the  NBS  standard  phasemeter.  The  relay,  in  effect,  per- 
mitted time-sharing  the  phasemeter  between  two  inputs,  simulating  a  conventional  two-input  phasemeter. 
A  programmable  frequency  synthesizer  was  connected  to  the  filter  input,  with  appropriate  padding  to 
present  a  600  n  source  resistance.  The  filter  was  also  terminated  in  600  n.  The  signal  at  the  filter 
input  was  connected  to  one  of  the  two  phasemeter  inputs,  and  the  filter  output  was  connected  to  the 
other.  Thus,  the  phaseshift  through  the  filter  was  simply  the  phase  angle  between  the  two  phasemeter 
inputs. 

The  synthesizer  was  stepped  at  30  Hz  intervals  from  30  Hz  to  10,770  Hz.  At  each  frequency,  256 
amplitude  samples  were  taken  on  each  channel,  covering  precisely  one  cycle  at  the  signal  frequency.  A 
discrete  Fourier  transform  then  allowed  the  computation  of  the  filter  phase  shift  at  that  frequency. 
The  reduced  data  (phase  versus  frequency)  were  then  fitted  to  a  second-degree  polynomial.  The  phase 
linearity  was  very  good,  but  the  conclusive  determination  was  made  by  using  the  fitted  phase  function 
with  simulated  data,  as  described  next. 

A  complete  measurement  of  the  composite  signal  was  simulated  by  computing  1024  amplitude  samples 
in  which  the  only  noise  was  due  to  the  14-digit  precision  of  the  computer  used  for  this  purpose.  When 
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these  data  were  reduced,  by  the  same  machine,  there  was  a  offset  of  only  about  54  microdegrees.  Then 
the  partially  reduced  simulated  data  were  perturbed,  using  the  filter  function  discussed  above,  to 
simulate  very  closely  the  effects  that  the  actual  filter  would  have  produced.  There  was  an  insignifi- 
cant change  in  the  54  microdegrees  offset.  The  conclusion  is  that  the  filter  does  not  degrade  the 
phase  integrity  of  the  standard. 


11.  Maintenance  Procedures 

Three  areas  of  maintenance  are  discussed  here:  adjustments,  performance  checks,  and  trouble 
shooting.  There  is  no  preventive  maintenance  as  such  for  the  system.  The  section  on  adjustments 
mainly  covers  the  analog  elements  of  the  system  and  describes  the  procedures  originally  used  to  set 
the  circuits  to  their  design  values.  The  trouble  shooting  section  is  quite  brief,  dealing  mainly  with 
getting  started  toward  finding  malfunctions  in  the  digital  elements  of  the  system. 

11.1  Adjustments 

Run  the  system,  for  at  least  30  min  to  stabilize  internal  temperatures,  then  perform  the  following 
adjustments,  in  order. 

5  Volt  Power  Supply.  The  main  power  supply  contains  an  output-voltage  adjustment.  Connect  a 
suitable  dc  voltmeter  to  the  +5  V  test-output  receptacle.  Set  the  adjustment  (labelled  5  ±  5  percent 
VDC)  for  5.0  V  ±  0.1  V. 

Oscillator.  Connect  a  frequency  counter  to  the  ((>  test-output  receptacle.  Use  the  adjustment  on 
the  oscillator  (labelled  FREQ.  ADJ.)  to  set  the  frequency  to  1,080,000  +  1  Hz.  Note  that  this  oscil- 
lator is  more  accurate  than  the  time  bases  in  some  frequency  counters,  and  caution  should  be  exercised 
in  readjusting  its  frequency.  An  external  standard  may  be  required. 

DAC  Adjustments.  See  section  10.3.  Adjust  the  time  delays  as  noted.  Final  adjustment  is  best 
accomplished  by  using  the  following  procedure: 

Connect  the  cable  carrying  the  9960  Hz  FM  data  to  a  "T"  cable  that  allows  driving  two  DACs  simultane- 
ously with  that  signal.  Connect  a  two-channel  oscilloscope  to  the  unfiltered  DAC  outputs  and  trigger 
the  oscilloscope  with  the  sign  bit  of  the  30  Hz  reference  phase.  Set  the  sweep  speed  to  10  ns  per 
division.  Superimpose  the  two  traces  vertically,  using  the  oscilloscope  controls.  Superimpose  them 
in  time  by  adjusting  the  time  delay  on  either  DAC.  Only  very  minor  adjustment  should  be  needed. 
Reverse  the  connections  to  the  oscilloscope  to  ensure  that  the  channels  have  a  negligible  differential 
delay.  If  they  do  not,  compensate  accordingly.  Replace  either  of  the  DACs  with  the  third  DAC  and 
adjust  the  third  DAC  in  the  same  manner.  In  this  way,  all  three  DACs  have  been  adjusted  to  have  the 
same  overall  time  delays,  and  differential  phase  errors  are   made  negligible  at  the  output  ports  of  the 
generator. 

Low-Pass  Filter.  There  are  no  adjustments  available  on  the  low-pass  filter. 

Phase  Compensation.  The  phase  compensation  switches  provide  a  means  of  advancing  (or  delaying) 
the  start  of  the  9960  Hz  signal  to  ensure  that  its  principal  zero  crossing  occurs  exactly  90.00°  after 
the  corresponding  point  of  the  30  Hz  reference  signal.  This  circuit  was  included  early  in  the  design 
under  the  assumption  that  it  might  be  necessary  to  compensate  for  phase  nonlinearity  in  a  low-pass 
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filter.  This  has  since  been  found  to  be  unnecessary,  and,  in  fact,  undesirable.  The  switches  should 
all  be  set  to  provide  zero  compensation  (all  switches  closed).  If  any  switch  is  open,  the  90.00°  test 
will  fail.  The  test  will  pass  if  the  thumbwheel  front  panel  switches  are  set  to  the  value  programmed 
by  the  phase  compensation  switches.  This  feature  has  been  allowed  to  remain  in  the  instrument  for 
possible  future  experiments,  but  is  never  used  for  calibration  purposes.  The  "untweaked"  status  of 
the  generator  is  thus  maintained. 

11.2  Performance  Checks 

In  addition  to  the  parameters  covered  in  section  11.1,  a  few  other  measurements  can  be  made  to 
verify  that  overall  performance  has  not  deteriorated.  There  are  no  specific  adjustments  associated 
with  these  measurements.  If  performance  has  deteriorated,  the  reasons  must  be  determined  through 
troubleshooting  procedures.  However,  the  performance  will  be  affected  by  the  adjustments  of  section 
11.1,  and  these  performance  measurements  should  be  made  after  final  adjustments  have  been  made.  It  is 
assumed  that  the  error-detection  circuits  show  no  errors  and  that  the  internal  (built-in)  tests  have 
been  performed  and  passed. 

Phase-Lag  Tests.  Certain  failures  in  the  phase-lag  setting  circuits  could  go  unnoticed  in  normal 
operation.  In  particular,  some  switch  settings  could  give  erroneous  values  of  lag.  It  is  not  fea- 
sible to  check  each  of  the  39,999  settings.  However,  it  is  straightforward  to  check  each  digit  over 
its  full  range.  Proceed  as  follows.  Connect  a  two-channel  oscilloscope  to  the  generator,  with  one  30 
Hz  signal  to  each  input.  Trigger  externally,  using  the  sign  bit  of  the  reference  signal.  Set  the 
sweep  speed  at  1  or  2  ps  per  division.  Starting  with  a  phase-lag  of  zero  on  the  thumbwheel  switches, 
advance  slowly  to  0.09°  while  watching  the  relative  phase  of  the  two  signals.  They  should  begin  per- 
fectly in  phase  (less  than  10  ns  offset)  and  move  apart  in  nine  equal  steps  of  926  ns,  one  for  each 
new  step  on  the  0.01°  switch.  This  verifies  that  the  0.01°  delay  is  functioning  properly.  Repeat  for 
all  of  the  higher  order  switches,  decreasing  the  sweep  speed  by  a  factor  of  10  for  each  successively 
higher  order  digit.  The  100°  switch,  of  course,  can  be  tested  only  to  300°. 

Spectrum  Measurements.  The  overall  performance  of  all  three  channels  can  be  observed  by  measur- 
ing the  spectra  of  the  three  signals.  By  comparing  these  spectra  with  the  data  obtained  in  the  origi- 
nal tests  of  the  system,  any  serious  departure  from  the  original  state  can  be  detected. 

There  are  two  approaches  that  may  be  used.  In  the  first,  a  commercial  low  frequency  spectrum 
analyzer  with  a  plotter  output  can  provide  a  comparison  spectrum.  Figure  10-1  was  made  in  this  way. 
If  the  output  amplitude  is  the  same  as  for  the  original  test,  the  later  plot  can  simply  be  laid  over 
the  original  to  detect  deviations.  Of  course,  the  30  Hz  spectra  should  show  only  a  single  line  at 
30  Hz. 

The  second  method  involves  the  use  of  the  NBS  standard  phasemetei".  This  is  the  best  method  for 
checking  the  performance  of  the  9960  Hz  circuits.  The  relative  amplitudes  of  the  lines  from  9420 
through  10,500  Hz  are  compared  to  the  fundamental  at  9960  Hz.  These  amplitudes  should  follow  closely 
the  predicted  values  [3]. 

11.3  Trouble   Shooting 

The  main  requirements  for  finding  other  than  obvious  troubles  are  a  reasonable  understanding  of 
the  system  design  principles  and  circuits  and  a  good  oscilloscope.  The  principles  and  circuits  have 
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already  been  covered.     The  oscilloscope  should  have  a  pass-band  of  at   least  20  MHz,   a  two-   (or  four-) 
trace  input   capability,   and  a  dual   time-base.     A  digitally-delayed  sweep  is  useful    but   is   not  essen- 
tial . 

A  number  of  points   should  be  kept   in  mind. 

1.  The  three  channels   are  independent   of  each  other  except   for  their  phase   relationships.     Any  one 
channel    can  fail   while  the  other  two  still    function. 

2.  The  only  elements  that   affect   all    channels   are  the  5  V  power  supply   and  the  clock  circuits. 

3.  The  error-detection  circuits  may  not  indicate  a  gross   failure  in  a  channel. 

4.  The  simplest  test  of  overall    operation   is  to  observe  the  individual    channel   outputs   on  the 
oscilloscope.     Triggering  the  scope  from  the  variable  phase  sign   bit  permits  examination   of  the 
individual    cycles   of  the  9960  Hz  output   by  changing  the  phase-lag  setting.     The  30  Hz  outputs 
should  be  perfectly  clean  sine  waves,   and  the  9960  Hz  output  should  have  uniform  amplitude 
everywhere.     Any  small   part  of  it  should  appear  to  be  a  clean  sine  wave. 

5.  A  ROM  or  accumulator  failure,   no  matter  how  minor,   usually   results   in  an  output  signal   that   bears 
no   resemblance  whatsoever  to  the  desired  signal.      If  the  signal    appears   normal    over  only  part  of 
the  cycle,   noting  the  precise  point  of  failure  helps  to   localize  the  trouble. 

6.  The  three   DAC  cards  may   be  interchanged  with   each  other  to   localize  faults. 

7.  The   (j)    signal    is  the  main  clocking  signal    for  all    channels.     Nearly   all    clocked   flip-flops  are 
triggered   by  the  trailing  edge  of   (^  .     The  other  three  clock   signals   are  used  as   synchronizing 
and  strobe  signals   in  the  phase-lag  control,   phase-compensation,   ROM-multiplexing,   error- 
detection,   and   built-in-test  circuits. 

8.  The  internal    control    signals   always   lead  the  actual    0°   point  of  the  analog  output   signals.     Do 
not   assume  that  these  signals   are  at  the  zero  crossing  points  of  the  sine  or  FM  signals. 

12.     Suggestions  for  Future  Designs 

During  the  development  of  this   system  a  number  of  design  simplifications   became  apparent.     For 
the  most  part,   we  chose  not  to  incorporate  these  simplifications   into  the  present  system,   since  doing 
so  would  have  delayed  its   completion.     However,   it  will    probably   be  cost-effective  to  incorporate 
these  into  a  future  system  if  one  is  to  be  constructed. 

12.1  30  Hz  ROM  and  Accumulators 

In  the  30  Hz  channels  a  14-bit  value  of  the  sine  function  is  computed,  but  only  the  13  most- 
significant  bits  are  used.  The  size  of  the  30  Hz  ROM  can  be  cut  in  half,  using  only  one  bit  per  word. 
Examination  of  a  complete  printout  of  all  9001  first  differences  reveals  that  the  present  precision  of 
8188  can  be  maintained  with  half  the  present  memory  by  supplying  a  1  or  0  from  a  flipflop.  It  changes 
state  from  1  to  0  at  some  point  away  from  the  zero  crossing.  The  pattern  shows  only  "l"s  and  "2"s  in 
the  region  of  rapid  change,  and  only  "0"s  and  "l"s  near  the  peak  of  the  wave,  where  the  slope  is  zero. 
Thus,   only  one  bit   per  word   is   sufficient,   if  the  flipflop   is  added. 

12.2  Reduced  Sampling  Rate 

In  the  present  system  there  are  36000  samples  per  30  Hz  cycle  and  about  108.3  samples  per  9960  Hz 
cycle.  If  these  numbers  can  be  reduced  without  degrading  overall  performance,  then  the  size  of  ROM 
can  be  reduced  correspondingly.  In  the  limit,  the  sampling  theorem  requires  just  two  samples  per  30 
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Hz  cycle  or  per  nominal  9960  Hz  cycle. ^  In  principle,  the  sampling  rate  could  be  reduced  by  a  factor 
of  about  50  and  still  be  fast  enough  for  the  9960  Hz  generator.  However,  if  this  were  done,  the  low- 
pass  filters  at  the  analog  outputs  would  need  to  have  much  sharper  cutoff,  so  much  so  that  conven- 
tional analog  filters  would  no  longer  be  practical.  The  optimum  tradeoff  between  number  of  samples 
per  cycle  and  filter  complexity  is  not  apparent,  particularly  in  view  of  the  need  for  low  group-delay 
distortion  of  the  9960  Hz  FM  signal.  However,  if  adequately  stable  filters  with  accurately  known 
characteristics  can  be  constructed,  then  the  9960  Hz  FM  signal  can  probably  be  predistorted  to  compen- 
sate for  amplitude  and  phase  distortion  introduced  by  the  filter.  Such  an  approach  might  permit  a 
major  reduction  in  the  sampling  rate  and  a  corresponding  reduction  in  ROM  size. 


VOR  PHASEMETER 


13.  Phasemeter  Details 


This  section  describes  the  hardware  and  software  developed  to  allow  measurements  of  the  composite 
audio  signal  generated  by  the  NBS  standard  VOR  generator  discussed  above.  A  general  discussion  of  the 
VOR  system  was  given  in  sections  1  and  2.  For  a  complete  analytical  description  of  the  mathematical 
model  used  for  the  VOR  waveform,  and  for  an  analysis  of  the  phasemeter  measurement  principle,  see 
Vecchia  [5]. 

13.1  Phasemeter  Design  Principles 

The  phasemeter  is  very  simple  in  comparison  to  the  generator.  It  was  assembled  completely  from 
commercial  off-the-shelf  modules  and  instruments.  By  far  the  most  complexity  lies  in  the  software 
that  runs  it. 

In  the  development  of  both  the  standard  generator  and  the  standard  phasemeter,  the  approach  was 
to  avoid  analog  circuitry  as  much  as  possible.  The  design  objective  for  the  phasemeter  was  a  bearing 
angle  uncertainty  of  not  more  than  0.01°.  The  design  of  filters  and  an  FM  demodulator  capable  of  this 
uncertainty  did  not  appear  feasible.  Instead,  a  sampling  approach  was  used.  A  block  diagram  of  the 
phasemeter  is  shown  in  figure  13-1. 
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Figure   13-1.     Simplified   block   diagram  of  the   phasemeter. 

2Note  that  a   "band-pass"   version   of  the   sampling  theorem  indicates   that  the   sampling   rate  need  only 
provide  two   samples   per  cycle   for  the   bandwidth   of  the   9960   Hz   signal.     Since  the   -80  dB   bandwidth   of 
this   signal    is   about   1620   Hz,   the  sampling   limit   is   about   3240   Hz,   as   compared  with   the   requirement 
for   roughly   20,000   samples/s   based  on  the   9960   Hz   carrier  frequency   itself.     However,    it   is   not 
apparent   how  to  construct   a   highly   accurate   system  based  on  the  band-pass   interpretation   of   sampling 
and   data   reconstruction. 
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The  composite  analog  waveform  from  the  VOR  generator  under  test  is  applied  to  the  analog-to- 
digital  converter  (ADC),  which  contains  a  track-and-hold  amplifier  at  its  input.  A  timing  reference 
signal,  such  as  the  30  Hz  reference  DAC  sign  bit  in  the  NBS  generator,  is  obtained  from  the  source 
under  test.  It  provides  an  arbitrary  point  from  which  all  sample  delays  are  measured.  Its  phase 
relative  to  the  fundamental  30  Hz  signal  is  unimportant,  but  it  must  be  stable  over  the  length  of  time 
required  to  take  the  data  (about  6.5  min  per  set).  The  controller  programs  the  delay  generator  for  an 
initial  delay  of  0  and  arms  it  to  output  one  trigger  pulse  to  the  ADC  upon  the  arrival  of  the  next 
timing  signal  from  the  source.  Upon  receipt  of  the  trigger  from  the  delay  generator,  the  track-and- 
hold  amplifier  switches  to  the  hold  mode  and  the  16  bit  analog-to-digital  conversion  is  completed. 
The  controller  reads  the  digital  data  from  the  ADC,  causes  the  programmed  delay  time  to  be  incre- 
mented, and  re-arms  the  delay  generator.  This  cycle  is  repeated  until  1024  samples,  equally  spaced  in 
time,  have  been  acquired.  The  effective  spacing  is,  of  course,  1/(30*1024)  s,  or  about  32.55  us.  The 
delay  generator  used  has  a  time  resolution  of  10  ps,  a  jitter  of  200  ps  rms  maximum,  and  an  absolute 
uncertainty  of  ±1  ns  ±  (time  base  uncertainty).  These  specifications  are  critical  to  the  application; 
a  delay  generator  with  ±100  ns  uncertainty  or  jitter  is  inadequate.  Note  that  the  peak  jitter  of  282 
ps  corresponds  only  about  3  microdegrees  at  30  Hz. 

Following  the  acquisition  of  the  amplitude  samples,  the  data  are  processed  by  the  same  computer 
that  controls  the  system.  A  fast  Fourier  transform  (FFT)  is  used  to  compute  the  frequency-domain 
spectrum  of  the  composite  signal.  The  fundamental  is  the  30  Hz  variable-phase  component.  The  phase 
angle  of  the  fundamental  and  the  phases  of  all  of  the  other  harmonics  are  relative  to  the  arbitrary 
timing  reference.  By  appropriate  manipulation  of  this  phase  information  [5],  the  VOR  bearing  angle 
can  be  computed.  This  computation  is  discussed  in  more  detail  in  section  15. 

14.  Hardware  Details 

The  hardware  components  used  to  assemble  the  phasemeter  are  listed  in  table  14.1.  At  the  time  of 
the  original  design,  all  items  were  available  commercially.  Since  then,  however,  the  manufacturer  of 
the  16-bit  ADC  used  has  discontinued  it.  Therefore,  another  unit  must  be  selected  if  one  wishes  to 
duplicate  the  system.  Since  replacements  for  the  original  unit  are  not  available,  we  plan  to  replace 
the  ADC  in  the  NBS  system  as  well.  Specifications  of  the  units  used  are  also  given  in  table  14.1  to 
assist  in  identifying  suitable  substitute  components. 

It  is  imortant  to  understand  that  the  commercial  equipment  listed  in  table  14.1  is  not  neces- 
sarily the  only  equipment  suitable  for  this  application;  indeed,  it  may  not  even  be  the  best  suited. 
Mention  of  specific  items  does  not  constitute  an  endorsement  of  the  product  by  the  National  Bureau  of 
Standards;  NBS  has  made  no  attempt  to  evaluate  all  of  the  various  possible  choices.  Such  mention  is 
made  here  only  to  facilitate  the  duplication  of  the  phasemeter  by  interested  parties. 

Finally,  it  should  be  noted  that  NBS,  after  examining  VOR  audio  generators  from  four  different 
companies,  has  found  none  that  are  suitable  for  use  as  transfer  standards,  for  various  reasons.  This 
situation,  unfortunately,  reduces  the  incentive  to  build  in-house  standard  phasemeters.  The  problems 
seen  in  commercial  VOR  audio  generators  include  excessive  time  jitter  (short  term)  in  the  timing  sig- 
nal, inaccurate  or  unstable  deviation  of  the  9960  Hz  signal,  and  noise.  Most  generators  are  not  crys- 
tal controlled,  and  even  those  that  are  appear  to  provide  insurmountable  problems  to  the  NBS  phase- 
meter approach.  Consequently,  the  principal  value  of  the  NBS  phasemeter  lies  in  providing  the  assur- 
ance that  the  NBS  generator  is,  in  fact,  an  accurate  generator  of  the  VOR  composite  waveform. 


31 


Table  14.1.     Critical    component   specifications. 


Analog-to-digital    converter,   including  track-and-hold  amplifier 


Resolution 

Accuracy 
Linearity 
Offset 
Gain 
Noise 

Stability 
Gain 

Nonlinearity 
Power  supply   sensitivity 

Conversion  time 

Input   range 

Input  impedance 

Output  coding 

Time  delay  generator 
Mode 
Range 
Step  size 

Absolute  uncertainty 
Jitter 

External  trigger  input 

Output  pulse 

Time  base: 
Aging 

Short   term 
Temperature 
Line  voltage 


16  bits    (as  tested,   14  may   be  adequate) 

1/2  LSB  in   laboratory  environment 
Unimportant   if  stable  and  less  than   10  mV 
Unimportant   if  stable  over  measurement  time 
Less  than  1   LSB   (153   uV  for  16  bits) 

+7  ppm/°C 
±2  ppm/°C 
±0.002%/% 

Unimportant   if  less  than   10  ms    (see  note   1) 

±5  V 

1000  nn  (see  note  2) 

(see  note  3) 


Externally  triggerable,   single  cycle 

0  to   33.333333...   ms 

50  ps  minimum 

±1  ns  ±  time  base  uncertainty 

200  ps   rms  maximum  between  ext.   trigger  and  output 
pulse 

Positive   slope,   threshold  at   about  2  V,   TTL  compatible 

TTL  compatible,   or  as   required  by  ADC 

(see  note  4) 

<5  X  10"-^°  per  day 

<1  X  lO"''--'-  for  1  s  average 

<7  X  10-9  for  0°  to   55°C 

<1  X  10"^^,   ±  10%  of  nominal 


Note  1.     The  conversion  time  interacts  with  the  track-and-hold  droop  specification  to  determine 
the  overall    accuracy  of  the  ADC.     For  this   reason,   it   is  desirable  to  obtain  an   integrated  module  that 
is   specified  overall    by  the  manufacturer. 

Note  2.     The  input   impedance  is   not  critical    unless  the  converter  is  to  be  capacitively  coupled 
to  the  VOR   generator.     The   1000  Mn  specification   applies  to  the   NBS  unit  used. 

Note  3.     The  output   coding  is   not   important   except  to  the  extent  that   NBS-provided  software  is 
used.      It   is  designed  to  accept  complemented  2s   complement   binary,   because  this   code   requires  the 
least   conversion   by  the  computer. 

Note  4.     These  specifications   apply  to  the  unit  used   by   NBS  and   represent  what   has   been  tested 
and  evaluated,   not   necessarily  what   is  absolutely   required. 
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The  computer  used  in  the  NBS  system  is  the  Hewlett-Packard  9845B,  with  186  kbytes  of  user  memory. 
The  software  requires  ROM  extensions  for  I/O  operations,  graphics  (optional),  IEEE-488  bus  operations, 
and  a  real-time  clock  (optional,  but  recommended  for  documenting  measurement  runs).  The  software  uses 
statements  in  extended  BASIC  that  are  not  available  on  the  older  9845A.  The  software  presumably  will 
run  on  the  9845C. 


15.  Software  Details 

15.1  General 

The  program  listing  in  appendix  A  is  the  complete  code  for  the  phasemeter.  It  contains  all  of 
the  instrument  drivers  for  acquiring  the  data,  and  the  processing  routines  for  computing  the  VOR  bear- 
ing angle.  If  more  than  one  measurement  at  a  given  bearing  is  taken,  it  will  compute  statistics  on 
the  set  of  measurements.  It  also  contains  some  subroutines  which  are  used  primarily  for  diagnostic 
purposes,  such  as  evaluating  the  quality  of  an  unknown  generator,  or  testing  the  accuracy  of  the 
phasemeter  ADC. 

All  of  the  variables  in  this  program  are  global.  Subprograms  are  not  used.  Since  variable  names 
and  labels  may  have  up  to  15  characters  in  this  extended  BASIC,  variable  names  can  be  made  mnemonic  to 
a  high  degree.  Therefore,  there  was  no  attempt  to  partition  the  code  into  independent  subprograms 
with  local  variables. 

In  several  places  in  the  sample  printouts  to  follow,  the  term  "dtg"  is  used.  This  refers  to  a 
date-time  group,  coded  as  a  10-digit  number,  that  identifies  when  a  particular  event  occurred.  It  is 
a  numerical  representation  of  the  date  and  time  in  the  form  YYMMDDHHMM;  for  example,  "8210071430" 
refers  to  October  7,  1982,  at  2:30  p.m.  The  year  information  is  input  by  the  operator  at  the  begin- 
ning of  each  session;  the  remainder  of  the  data  come  from  the  computer  real-time  clock.  This  results 
in  a  unique  number  that  identifies  every  measurment,  software  revision,  and  flexible  disk.  It  is  also 
the  means  of  tracing  any  printout  output  back  to  the  original  raw  data,  and  provides  the  time  dimen- 
sion on  the  quality  control  charts. 

The  interactive  initialization  portion  of  the  program  will  be  discussed  first,  then  data  acquisi- 
tion and  storage,  and  finally  data  processing.  All  line  number  references  are  for  code  revision  date 
"8207140822."  See  line  100,  appendix  A. 

15.2  Initialization 

This  portion  begins  at  line  2700.  All  arrays  are  dimensioned  in  lines  2720  through  2840.  Line 
2860  is  used  only  on  certain  occasions,  as  discussed  in  section  15.4. 

The  printer  specifier.  Printer,  and  the  mass  storage  unit  specifier,  Disk$,  are  supplied  by  the 
user.  It  is  not  necessary  to  store  the  data  on  the  same  disk  as  the  program,  but  it  is  often  a  good 
idea.  This  practice  avoids  confusion  as  to  which  code  revision  was  used  to  process  the  data. 

The  program  asks,  in  line  3120,  what  the  nominal  bearing  angle  is,  Nom_bearing.  This  information 
is  used  only  to  compute  deviations  between  the  measured  value  and  the  nominal  value;  it  is  not  used  in 
any  other  way. 
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Next,  the  user  tells  the  program  whether  old  data  is  to  be  processed,  or  new  data  is  to  be  taken. 
This  provision  allows  data  to  be  taken  at  one  time  and  then  processed  or  reprocessed  when  convenient. 
Unless  the  program  is  interrupted,  all  new  data  are  processed  in  the  run  in  which  taken.  Also,  all 
new  data  are  automatically  stored  on  disk  for  future  reference. 

If  new  data  are  to  be  taken,  subroutine  Check_files  checks  the  disk  to  see  if  there  is  enough 
space  for  the  number  of  measurements  specified  earlier  by  No_measmnts.  If  not,  it  tells  the  operator 
and  suggests  alternatives. 

This  routine  completes  the  initialization  process. 

IB. 3  Data  Acquisition 

If  new  data  are  to  be  taken,  the  loop  beginning  at  line  3340  is  executed.  Three  subroutines  are 
nested  within  it,  and  they  have  further  routines  nested  within  them. 

"Setup_5359"  initializes  the  time  delay  generator  by  sending  command  strings  over  the  IEEE-488 
interface  to  define  the  operating  parameters  needed,  including  the  delay  step  size.  This  string  is 
fixed  in  this  program  because  the  fundamental  frequency  is  always  30  Hz  and  1024  samples  are  always 
taken. 

"Take_data"  begins  at  line  3940.  It  prints  a  date-time  group  from  the  real-time  clock  to  iden- 
tify the  printout.  It  initializes  the  array.  Integer data,  in  which  the  ADC  output  will  be  stored. 

Then  it  begins  the  loop  that  arms  the  generator,  reads  the  ADC,  tests  for  ADC  overload,  puts  the 
sample  in  the  array,  increments  the  delay,  and  re-arms  the  generator.  The  WAIT  statements  in  this 
loop  are  required  to  allow  the  delay  generator  to  become  "unbusy"  after  being  incremented.  In  the 
aggregate,  these  delays  account  for  almost  2  min  of  the  6.5  min  required  to  acquire  1024  samples. 

"Store_data,"  starting  at  line  5020,  is  used  next  to  put  the  data  array  on  disk,  along  with  cer- 
tain pieces  of  housekeeping  information,  such  as  the  date-time  group.  It  names  the  file,  after 
examining  the  files  already  on  the  disk,  and  prints  the  data  to  the  disk.  The  file  name  itself  also 
becomes  a  part  of  the  file.  A  list  of  the  housekeeping  items  that  accompany  every  data  file  is  given 
in  lines  1020  through  1400. 

This  portion  of  code  completes  the  acquisition  and  storage  of  one  measurement.  This  data  acqui- 
sition loop  is  repeated  No_measmnts  times.  It  is  then  processed  by  going  to  subroutine  Retrieve_data, 
which  is  discussed  under  the  next  section. 

15.4  Data  Processing 

Data  processing  begins  with  Retrieve_data,  line  5300.  If  old  data  is  to  be  processed,  the  opera- 
tor enters  the  number  of  the  first  file  in  the  set  and  the  number  of  measurements  in  the  set.  Various 
items  are  checked  by  the  program,  and  if  the  file  is  valid  and  unprocessed,  the  actual  processing 
begins  at  line  6460,  where  the  routine  Fft_driver  is  called.  This  routine  puts  the  1024  data  points 
into  two  arrays,  R(*)  and  I(*),  512  points  in  each,  alternating.  Subroutine  Fft  is  then  called,  and 
the  transform  is  computed  in  lines  10320  through  11680.  Arrays  R(*)  and  l{*)   now  contain  the  real  and 
imaginary  parts  of  512  spectral  lines. 
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Following  the  transform,  the  signs  of  the  elements  in  R(*)  and  !(*)  are  corrected  from  a  table  of 
Bessel  functions,  Jn(*).  The  phases  of  each  line  are  computed  and  the  proper  quadrant  assigned. 

The  phase  angles  progress  uniformly  from  spectral  line  to  line,  the  difference  between  the  phases 
of  adjacent  lines  depending  on  the  bearing  angle.  At  most  settings,  the  phase  difference  exceeds 
360°,  and  it  is  necessary  to  add  or  subtract  multiples  of  360°  to  order  the  lines  correctly.  This 
processing  is  done  in  the  section  labelled  Order_lines,  beginning  at  program  line  8500. 

The  remainder  of  the  Fft_driver  routine,  lines  9240  through  10300,  does  two  linear  regressions  on 
the  ordered  phase  angles.  The  first  regression  covers  only  the  lines  -7  through  +7,  i.e.,  9750 
through  10170  Hz.  Its  purpose  is  to  determine  the  slope  of  the  phase  versus  line  number  plot  in  order 
to  best  determine  the  value  for  the  -8th  and  +8th  lines.  This  regression  done,  a  second  regression 
covers  the  entire  range  from  the  -18th  through  the  +18th  lines. 

Subroutine  Estimation  (line  11700)  is  called  next.  It  is  based  on  the  analysis  by  Vecchia  [5]. 
The  subroutine  uses  the  results  of  the  preceding  step  to  compute  three  phase  angles,  and  from  these 
the  VOR  bearing  angle  is  found.  The  three  angles  result  from  the  generality  of  the  waveform  model  and 
allow  an  arbitrary  phase  relationship  between  the  timing  reference  signal  used  in  data  acquisition  and 
the  fundamental.  As  part  of  the  Estimation  routine,  an  estimate  is  made  of  the  standard  deviation 
that  would  be  expected  if  the  measurement  were  to  be  repeated  a  large  number  of  times.  This  estimate 
is  based  on  the  assumption  that  noise  in  the  data  is  random  in  nature.  In  fact,  it  is  not,  and  con- 
sequently the  estimate  of  the  standard  deviation  tends  to  be  too  high  (conservative)  by  about  a  factor 
of  3  to  10.  This  estimate  is,  nevertheless,  a  useful  measure  of  the  validity  of  the  measurement  and 
can  be  used  to  flag  a  bad  one.  This  flagging  is  done  by  the  program  automatically  if  the  estimated 
standard  deviation  exceeds  a  rather  arbitrary  threshold  that  was  set  to  0.005°  after  making  a  large 
number  of  measurements  on  the  NBS  standard  generator. 

If  there  is  more  than  one  measurement  in  the  set,  routine  Statistics  (line  4320)  is  called.  This 

routine  computes  the  variance,  standard  deviation,  and  mean  of  the  set.  It  prints  these  results  and 

the  difference  between  the  mean  and  the  nominal  value.  If  there  is  only  one  measurement  in  the  set, 
only  the  result  and  the  difference  Are   printed. 

15.5  Utility  Subroutines  and  Programs 

Two  utility  subroutines  are   contained  in  the  program,  but  are  only  used  for  diagnostic  purposes, 
by  calling  from  the  keyboard.  The  first  routine  is  "Meas_print"  (line  13520).  It  prints  in  tabular 
form  the  real  and  imaginary  parts  of  the  fundamental  and  37  harmonics.  It  also  prints  the  line 
amplitudes,  unordered  phase  angles  in  radians,  and  ordered  phase  angles  in  degrees.  This  routine  is 
useful  for  determining  whether  there  was  a  misordering  of  the  lines,  due  to  noisy  data,  for  example 
(see  fig.  15-1). 

The  second  routine.  Plot,  plots  the  phase  angles  of  the  314th  through  350th  lines  as  a  function 
of  harmonic  number,  both  before  and  after  ordering.  With  experience,  it  can  be  used  to  determine 
whether  there  was  excessive  time  jitter  in  the  unknown  signal  or  in  the  timing  reference  (see 
fig.  15-2). 
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Figure   15-1.     Sample  diagnostic   output   of   routine   "Meas_print" , 
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Rmi  n  = 
Dnii  n  = 


C  o  d  €    r  e  '. .■  i  s  i  ci  n    d  t  g  :  S  £  0  7  1  4  0  S  2  2 
-2.745710863  0  3  R  rn  -a; 

-1507.  54  234  143  Druaj 


Ordtred  ar-Mglei. 

2.  012630331': 
1^35. 034024; 


Figure  15-2.     Sample  diagnostic  output   of   routine   "Plot". 


Data   taking    began    at    82:07:13:16:23:15 

Code  dtg:  8201011453.   Disk  dtg:  8204231351.   Fi 

Data  stored  in  file  DftT027:FS,0,  disk  8204231351 

Data  taking  began  at  82:07:13:16:29:42 

Code  dtg:  8201011453.   Disk  dtg:  8204231351.   Fi 

Data  stored  in  file  DFIT028:  FS,  0,  disk  8204231351 


Data  taking  began  at  82:07:13:16: 
Code  dtg:  8201011453.   Disk  dtg: 
Data  stored  in  file  DRT029:F8,0, 

Data  taking  began  at  82:07:13:16: 
Code  dtg:  8201011453.   Disk  dtg: 
Data  stored  in  file  DflT030:F8,0, 


36:09 

8204231351.   Fi 
disk  8204231351 

42:36 

8204231351.   Fi 
disk  8204231351 


Data   taking    began    at    82:07:13:16:49:03 

Code    dtg:     8201011453.       Disk    dtg:     8204231351.       Fi 

Data   stored    in    file    DflT031 :  F8, 0,     disk    8204231351 


ename:     VORl 
at    82:07:13:16:29:41 


ename:    VORl 
at    82:07:13:16:36:08. 


ename:    VORl 
at    82:07:13:16:42:35. 


ename:     VORl 
at    82:07:13:16:49:02. 


ename:     VORl 

at   82:07:13:16:55:29. 


Dwt  a  file 
DflT027 
DflT028 
DflT029 
DFIT030 
Dl=lT031 


Bearing  angle 
300.0001 
300.0012 
300. 0002 
300.0005 
300.0014 


Si  gmasq 
1.671E-02 
1.679E-02 
1.667E-02 
1.653E-02 
1.647E-02 


Est  .  St  d .  de'v'. 
4.055E-03 
4.065E-03 
4.051E-03 
4.034E-03 
4.026E-03 


Code  dtg:  8201011453.   Disk  dtg:  8204231351.   Filename:  VORl 

Mean: 360.000  685  degrees 

Nominal  bearing 300.00 

Variance: 3.460E-07 

Standard  dei.'iation: 5.882E-04  degrees 

Mean  minus  nominal: .800  685  degrees 

Figure  15-3.  Sample  output  resulting  from  five  measurements  at  one  phase  angle. 
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15.6  Sample  Outputs 

The  printed  output  produced  during  a  typical  measurement  run  is  shov^n  in  figure  15-3.  The  begin- 
ning and  ending  times  for  each  of  a  series  of  five  measurements  is  printed  as  the  data  are  taken.  The 
disk  identification,  code  name  and  revision  date,  and  data  file  name  are  also  printed.  All  of  these 
items  are  stored  on  the  disk  with  the  raw  data.  After  the  last  measurement  in  a  series,  each  data 
file  is  retrieved  and  processed,  resulting  in  the  lower  part  of  the  printout.  Finally,  if  more  than 
one  measurement  was  made  in  the  set,  the  mean,  standard  deviation,  etc.,  are  printed.  Some  of  the 
processed  data  results  are  returned  to  the  disk  to  allow  quick  abstracting  of  large  numbers  of  meas- 
urements without  reprocessing  the  data.  The  information  in  appendix  B  was  obtained  in  this  way. 

If,  in  the  initialization,  it  was  specified  that  old  data  was  to  be  processed,  the  program  jumps 
to  Retrieve_data.  If  new  data  acquisition  has  just  been  completed,  the  program  jumps  to  the  same  sub- 

routi  ne. 


EVALUATION  OF  THE  STANDARDS 

16.  VOR  Measurement  Principle 

The  principal  development  of  digital  methods  for  decoding  VOR  waveforms  derives  from  the  physical 
model  for  VOR  beacons.  To  represent  an  ideal  VOR  signal  mathematically  requires  two  periodic  func- 
tions described  by 


v(t;_e)  =  a-^   cos[2TTf]_t  +  92^  +  62] 


and 


s(t;_9)    =   02  cos[2TTf2t   +  93  +   g  sin[2Tif]_t   +  92]], 

where  _9  is  a  vector  of  unknown  phase  angles. 

The  waveform  generated  by  the  sum  of  v(t;_e)  and  s(t;_e),  with  some  parameters  specified,  may  be 
used  to  represent  the  ideal  audiofrequency  signal  for  the  VOR  navigation  system.  The  specification 
for  the  VOR  signal  generator  demands  that 

ai  =  a2  =  21/2  (1  V  rms) 

f^  =  30  Hz 

f2  =  9960  Hz  (so  f2/fi  =  332) 

e  =  16 

In  the  VOR  context,  v(t;_9)  is  the  30  Hz  variable  phase  signal,  and  s(t;_e)  is  the  frequency-modulated 
9960  Hz  subcarrier.  The  frequency  modulating  sinusoid  in  the  argument  of  s(t;_9)  is  the  reference 
phase  signal . 

The  design  of  VOR  beacons  is  such  that,  in  the  mathematical  model  of  the  signal,  Q-^   provides  the 
necessary  bearing  information.  The  description  in  the  following  subsection,  which  outlines  the  prin- 
ciple for  decoding  VOR  signals,  will  therefore  emphasize  the  estimation  of  e-|^ ,  although  the  nuisance 
phase  angles  82  and  83  are  estimated  simultaneously  by  the  phasemeter. 
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In  practice,  either  transmitted  or  synthesized  waveforms  will  be  accompanied  by  noise  or  measure- 
ment error.  This  distortion  is  modeled  by  adding  random  errors  or  noise  to  the  ideal  signal.  The 
resulting  noise  corrupted  voltages,  say  Y(t),  can  be  represented  by 

Y(t)  =  v(t;_6)  +  s(t;_e)  +  e(t). 

The  random  error  process  is  assumed  to  be  white  noise  when  sampled  at  the  rate  specified  for  the  digi- 
tal phasemeter. 

16.1  Measurement  of  VOR  Waveforms 

The  algorithm  used  to  estimate  the  unknown  phase  angles  Q-^,    62,  63,  relies  on  a  Fourier  transform 
method  to  process  noisy  samples  from  the  generated  waveform.  This  technique  requires  one  complete  30 
Hz  cycle  of  the  VOR  waveform,  digitized  at  1024  evenly  spaced  points  throughout  the  cycle.  The  number 
of  sampled  points  is  determined  by  the  requirement  that  the  upper  frequency  limit  of  the  discrete 
Fourier  transform  (DFT)  exceed  the  frequency  of  the  significant  FM  sidebands  of  the  332nd  harmonic  of 
30  Hz.  Because  the  FFT  algorithm  is  used,  it  is  efficient  to  require  2'"(m=10)  amplitude  samples. 

The  OFT  of  the  noisy  time  samples  was  shown  in  NBS  TN1021  [5]  to  have  Fourier  sine  and  cosine 
coefficients,  B|^  and  A|^  (kth  harmonic  of  30  Hz),  characterized  by 


E[B.] 


I 


and 


E[Ak]  = 


2^/2  sin(ei  +  62)  ,  k=l 

2^/2  J|^_232(16)sin[e3  +  (k-332)e2],  k=332-K, . . .  ,332, .. .  ,332+K 

2^/2  cos(9^  +  62)  ,  k=l 

2^/2  j|^_232(16)cos[93  +  (k-332)e2],  k=332-K 332, . . .  ,332+K 


Var[B|^]  =  Var[A|^]  =  a'^/SlZ, 

where  E[«]  is  used  to  denote  the  average,  or  expected,  value  of  repeated  measurements  of  noise- 
corrupted  sets  of  1024  time-samples,  Var[«]  denotes  the  expected  variability  of  repeated  measurements, 
J^(16)  is  a  Bessel  function  of  the  first  kind,  and  a   is  the  RMS  level  of  the  measurement  errors,  e(t). 
The  value  of  K  is  chosen  to  assure  that  only  the  most  powerful  sidebands  of  the  332nd  harmonic  are 
used  to  estimate  Q-^.     Figure  16-1  shows  an  amplitude  spectrum  obtained  from  an  ideal  VOR  waveform. 
Apart  from  the  30  Hz  component  (k=l,  outside  the  range  of  the  graph),  only  about  36  harmonics  centered 
on  k=332  have  sufficiently  high  si  goal /noise  ratio  to  be  used  in  the  measurement  algorithm. 

Inspection  of  the  Fourier  coefficients  reveals  that  the  essential  bearing  angle  information  con- 
tent of  the  DFT  is  likely  to  be  contained  in  the  phase  spectrum  of  amplitude  samples,  Q|^* 
=  Arctan(B|^/A|^)  for  admissible  k.  Having  transformed  the  DFT  coefficients  to  this  form,  it  was  shown 
in  reference  5  that  the  expected  value  and  variance  of  Q|^*  (for  admissible  k)  are 
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312   317   322   327   332   337   342   347   352 


Figure  16-1.  9960  Hz  subcarrier  spectrum,  showing  relative  sideband  amplitudes, 
The  abscissa  is  the  harmonic  number  relative  to  30  Hz. 


and 


where 


E[Q,*] 


( 9,   +  e^)  modZij  ,  k=l 

[02  +  {k-332)e2]mod2Tr,  k^l 


Var[Qu*]  =  r^-2a2/5i2. 


,   k=l 


2j\_332(16),    lk-332|    <  K. 
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The  equations  for  E[Q|^*]  are  essentially  linear  in  e^,  62  and  83,  except  for  the  restriction  to  the 
range  [0,  Z-n) .     However,  in  reference  5  a  procedure  was  outlined  for  adjusting  the  Q|^*  by  defining 

Qk  =  Qk*  +  Yk  2u. 

where  the  Yk's  are  integers  which  reorder  the  Qk*  to  be  consistent  with  the  physical  model.  The  y^' s 
are  easily  obtained  for  the  signal /noise  ratios  rendered  by  the  NBS  signal  synthesizer  in  its  current 
design. 

When  the  Qk  have  been  determined,  all  phase  angles  are  estimated  by  a  standard  linear  least 
squares  technique.  The  algorithm  also  provides  an  estimate  of  the  RMS  noise  level  and  obtains  esti- 
mated standard  errors  of  the  measured  phase  angles  from  a  single  sample  of  the  30  Hz  cycle. 

The  complete  model  and  measurement  equations  are  discussed  in  reference  5.  In  this  discussion  of 
the  measurement  technique,  only  the  algebraic  expression  of  the  measured  VOR  bearing  angle  is 
reported.  The  estimator  of  61  and  its  estimated  variance  are 

h-^-  %l^  ^   Ji^(16)[Q332,i  -  Q332_.] 


and 


S^(ej)  =  [(1  +  C^)/1024]a^ 

where 

C^  =  [2  1  i^J.2(i6)]-^ 
'^    i=l    ^ 

Here  a  denotes  an  estimate  of  the  RMS  noise  level,  but  will  not  be  further  specified  because  the  char- 
acterization of  the  VOR  measurement  process  and  establishment  of  statistical  stability  only  relies  on 
statistical  models  for  repeated  measurements  of  9^.  The  single  sample  estimated  standard  error  of  e^ 
is,  however,  a  useful  diagnostic  tool  because  it  is  sensitive  to  the  effects  of  isolated  erroneous 
time-samples  and  other  transient  influences. 

16.2  Verification  of  Mathematical  Model  by  Simulation 

Empirical  verification  of  the  measurement  method  was  achieved  by  computer  simulation  on  a 
CUC170/750.  To  more  closely  approximate  an  actual  system,  the  simulated  waveforms  were  corrupted  by 
additive  Gaussian  white  noise.  Results  of  the  investigation  indicated  that  measurement  of  VOR  bearing 
from  the  phase  spectrum  was  viable  for  RMS  noise  levels  which  are  characteristic  of  the  VOR  signal 
generator. 

Sample  printouts  of  simulated  VOR  measurements  are  shown  in  tables  16.1  A-L.  The  parameters 
listed  at  the  top  of  each  table  can  be  selected  to  generate  VOR  waveforms  for  any  configuration  within 
the  following  specifications: 
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NUMBER  OF  OBSERVATIONS 
STANDARD  DEVIATION 
NUMBER  OF  RUNS 
NUMBER  OF  FREQUENCIES 

DEGREE  MODE 
TIME  JITTER 


Number  of  time-samples  (<1024) 

Standard  deviation,  a,  of  additive  Gaussian  white  noise  (a  >  0) ; 
Number  of  simulated  waveforms  desired  (1  <  n  <  20); 

Total  number  of  spectral  lines  for  measurement  (=  2  +  2K;  K  is  number  of 
sidebands  of  332nd  harmonic  to  be  used); 
Degrees  or  radians; 

If  ON  will  randomly  perturb  ideal  voltage  V^  to  V|.+y,  where  u  is  selected 
from  a  uniform  distribution  between  -1  ns  and  1  ns; 
VAR  PHASE  AMPLIT 
or  SUBCARRIER  AMPLIT 
FREQUENCY  (VAR  PH) 
FREQUENCY  (SUBCAR) 
MODULATION  INDEX 
THETAl,  THETA2, 
THETA3 

For  the  simulations  shown  in  the  tables,  these  parameters  were  assigned  the  values  listed.  The 
quantity  of  interest,  namely  THETAl,  was  chosen  in  30°  increments  from  0°  to  330°.  In  each  case  a 
sample  of  1024  amplitude  points  was  computed  with  each  point  perturbed  by  a  random  amount  to  simulate 
measurement  noise.  These  data  were  then  transformed  to  the  frequency  domain  using  a  complex  fast- 
Fourier  transform.  The  transform  gives  both  the  amplitude  and  phase  of  the  spectral  lines  in  the  fre- 
quency domain.  The  bearing  angle  was  then  estimated  from  the  transformed  data  by  a  least-squares  fit- 
ting technique  to  give  one  estimate  of  THETAl  in  the  output  table.  This  process  was  repeated  10 
times. 


Selected  value,  a^ ,  can  be  randomly  perturbed 

to  a,-  +  u^,  where  u^  is  uniformly  distributed  from  -1  to  1  V; 

Ideal  specification  (30  Hz)  can  be  randomly  perturbed  from  29  to  31  Hz; 

332  (perturbed  variable  phase  frequency); 

Ideal  index  (16)  can  be  randomly  perturbed  from  15  to  17;  and 

Phase  angles  of  noise-free  waveform. 


The  first  column  in  the  table  is  simply  the  run  number.  For  each  run  the  sequence  of  random 
amplitude  errors  is  completely  independent  of  errors  in  the  other  runs. 

The  second  column  in  the  table  gives  the  resulting  estimate  of  the  bearing  angle,  THETAl.  As  can 
be  seen  in  the  tables,  the  estimated  bearing  agrees  closely  with  the  selected  value,  even  with  a 
realistic  level  of  measurement  noise.  The  third  column  is  the  estimated  standard  deviation  of  the 
bearing  angle  estimate  in  column  2,  based  on  the  results  of  the  least-squares  fitting  procedure. 

At  the  bottom  of  the  printout  is  the  sample  mean  and  sample  standard  deviation  of  the  10  esti- 
mated bearing  angles.  A  measure  of  the  adequacy  of  the  measurement  principle  is  how  well  the  standard 
deviation  of  the  10  estimates  agrees  with  the  estimated  standard  deviations  from  the  individual  runs. 
Again,  the  agreement  is  very  good. 

The  FORTRAN  computer  program  which  produced  the  tables  in  this  section  is  available  from  the 
authors. 
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Table  16.1-A.  Simulation  estimates  at  0"^ 


WUNBEB    OnSE»V«TIONS    • 

1024 

THET41 

STANO*PO   0EVI4TI0N      « 

•            .00040 

TMET42 

NUMBER    OF    RUNS                 • 

10 

THET43 

NUNFEB    FPEOUENCIES      « 

•                     36 

0E6REE    fODE                       • 

•           DE6REF 

T1«E   JITTER 

•                  OFF 

V»R    RH»SE    •"PLIT           « 

>               1.00 

SUBC4PRIFR    4HPLIT        • 

1.00 

FPFOUFNCY    CV»R    PH)       • 

30.00 

FREOUENCV    (SUBCAR)      • 

■         9960.00 

KOOULATION    INDEX            ■ 

•              16.00 

0.00000  (  0.00  DECREES  ) 
1.57202  <  90. or  DE6REFS  » 
1.90479  (113.72  DEGREES  I 


RUN 


BEARINC  ANGLE  EST 


ESTINtTEO  STO  OEV 


10 

PEAN 
STO  OEV 


359.99954938570990 

359.99957171381720 

.00014775991736 

.00103240123701 

J59. 99995492313246 

8^9.9995^c5^s69^62 

359.99866019857836 

359.99967152872341 

.00240791006466 

359,9999f»309537114 


.00004894^22534 
.00102160353512 


.00119405563495 
.00108158915795 
.00111276992072 
.000959B7655964 
.00091899987674 
.00082092499755 
,00085147429091 
.00072194591567 
.00078422383887 
.00114704596514 


Table  16.1-B.  Simulation  estimates  at  30"^ 


NUHREP    r«SEPV»TIONS    ■ 

•                1024 

THETAl 

STANOARO    DFVIATION       • 

.00040 

TMFTA2 

NUMBER    OF    RUNS                  • 

10 

THETA3 

NUWPER    FREOiJENCIES      ■ 

38 

DEGREE    NOnE                       ■ 

DEGREE 

TIME    JITTEP 

OFF 

VAP    PHASE    AMRLTT           • 

1.00 

SUBCARRIER    ANPLIT         ■ 

1.00 

FREOUFNCT    (VAR    PH)       ■ 

30.00 

FPEOUENCY    (SUBCAR)       < 

•         9960.00 

NPDULATION    INDEX           ■ 

•              16.00 

.52360  I  3C.00  DEGREES  ) 
1.57202  «  90.07  DFGPFES  ) 
1.96479  1113.72  DEGREES  I 


RUN 


BEARING  ANGLE  EST 


ESTIMATED  STD  OEV 


10 


29.99993963623640 
30.00126027535339 
29.99861027460952 
30.00059817592546 
29.99990380965323 
30.0006015938?178 
29.99^83745969794 
29.99850603616278 
30.00014411366965 
29.99922476116856 


.00103392079157 
.00098759467156 
.00086885085629 
.00115525779303 
.00103392536103 
.00081133852902 
•00095294092419 
•00078911343697 
.90111572526560 
.00105429131367 


NEAN 
STD  DEV 


29.99976261563197 
•00093653649249 
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Table   16.1-C.     Simulation   estimates   at  60"^ 


NU»"BE»    OBSfBV»TIPNS 
ST»NO«PO    DEVIATION 
HU"HEB    OF    BUNS 
NUMBER    FREOUEHCIES 
CEGBEE   "ODE 
TIME   JITTEB 


van    »HA5E    «<1BLIT 
SUBC4BBIER    »HPLIT 
FBFOUFNCY    (V»R    PM) 
FBEOUENCY    (SUBC4B) 
HODULATinw    INDEX 


102* 

THET*1 

»000*0 

THFT42 

10 

THETI3 

39 

DE6BEE 

OFF 

1.00 

1.00 

30.00 

99ft0.00 

16.00 

1.047?0  (  60.ro  0E6PEES  ) 
1.57202  (  9C.07  DFGPEES  » 
l.«e«>7q  1113.72  DECREES  ) 


BUN 


BEABINC  ANGLE  EST 


ESTINATED  STO  OEV 


10 

NEAN 
STD  OEV 


60.0007 
60.0007 
60.0016 
60.001* 
60.0002 
99.9992 
99,999* 
99.9991 
99.9986 
99.9990 


3015787370 
95877900*2 
51285*1852 
939*312098 
7527279781 
511857533* 
7757181963 
809586?313 
218*537*10 
97775838** 


60.000097587*1135 
.00108077939295 


.0009 
.0009 
.0011 
.0008 
.0009 
.0010 
.0009 
.0011 
.0009 
.0009 


379«)9l*9*0 
9936623*93 
0351002312 
9815327859 
6892067312 
6782992517 
8389805568 
**6557166* 
629097530* 
9*857357*2 


Table  16.1-D.  Simulation  estimates  at  90' 


NUMBER  n^SERVATIONS 

■ 

102* 

TMETAl 

STANDARD  DEVIATION 

■ 

.000*0 

THETA2 

NUMBER  PF  BUNS 

■ 

10 

THETA3 

NUMBER  FREQUENCIES 

■ 

38 

DEGREE  »ODE 

■ 

DEGREE 

TIME  JITTEB 

• 

OFF 

VAR  PHASF  AMPLIT 

• 

1.00 

SUBCAPRIEP  AMPLIT 

■ 

1.00 

FREQUENCY  (VAB  PH ) 

■ 

30.00 

FREQUENCY  ISUBCAR) 

■ 

9960.00 

MODULATION  INDEX 

■ 

16.00 

1.97080  (  90.00  DEGREES  ) 
1.57202  (  90.07  DEGREES  ) 
1.98*79  (113.72  DEGREES  ) 


I  UN 

1 
2 
S 

4 
9 

6 
T 
• 

10 


REARING  ANGLE  EST 


ESTIMATED  STD  DEV 


89.999*6766523772  .0009099*066  897 

69.9987573900  2388  .0012  99235002*0 

90.0001*69*665219  .00112885025322 

90.00016768258*51  .0008*625622865 

90.0000966703  3  873  .00103*26753  230 

90.0003  85  2168  7338  .000762  362*6797 

90.0002256192  53  3*  .00092631936907 

99.99932038*7**39  .0009**6*99**00 

89,9992777961892  9  .001018*0209397 

89.9981998021 ?998  .0010263901231* 


89.999602713*0160 
.00073673660291 
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Table  16.1-E.  Simulation  estimates  at  120°. 


MUHBER  ruSFBViTIONS 

• 

10?« 

THETIl  • 

?T*NDi«0  DEVI4TI0N 

■ 

.000^0 

THET42  ■ 

NU«t>Ee  TF  BUNS 

■ 

10 

THETI3  • 

NU"BF»  FBEOUENCIES 

■ 

39 

DECREE  "ODE 

■ 

DECREE 

TIWE  JITTFB 

■ 

OFF 

V««  BMtSE  mBlIT 

■ 

l.CO 

SUBC*RRIfB  *HBLIT 

• 

1.00 

" 

FBEOUENCr  (V*R  FH ) 

■ 

30.00 

fREOUENrr  (SUBCAR) 

• 

9960.00 

HOOULATION  INDEX 

• 

16.00 

2.094«0  llZC.rC  DECREES  ) 
1.97?02  t  90.07  DEGREES  I 
1.96479  11X3.72  DEGREES  I 


RUN 


BEARING  ANGLE  EST 


ESTINATEO  STD  DEV 


10 


120.0009 
119.999* 
119.99B9 
119.9993 
120.0003 
120.0000 
120.000S 
120.0018 
119,«Q93 
120.0007 


♦718526007 
5213320871 
1*55*«*6*0 
7085692000 
♦8*721*783 
529592639* 
8927*91500 
6687731230 
1*6*739^20 
*91609626* 


.00118097086621 
.000982605*3182 
.000619379128*6 
.0010*969952930 
.00103307317101 
,00099709829517 
.00088536718816 
.00101293561*95 
.00103729955637 
.00109519962560 


NEAN    • 
STD   OEV   • 


120.0001206121810* 
.00088'91016223 


Table  16.1-F.  Simulation  estimates  at  150°. 


NUMBER  PBSERVATinNS 

■ 

102* 

THETAl 

STANOARn  nEVIATlON 

.■ 

.000*0 

THETA2 

NUMBER  OF  RUNS 

.m 

10 

THETA3 

NUMBER  FREQUENCIES 

,m 

36 

DEGREE  HCOE 

.m 

DEGREE 

TINE  JITTER 

m 

OFF 

VAR  PHASE  ANRIIT 

m 

1.00 

SUBCARRIFR  AMPllT 

m 

1.00 

EREOUENCY  (VAR  RH» 

■ 

30.00 

FREOUENCY  (SUflCARI 

.• 

9960.00 

NOOULATION  INDEX 

• 

16.00 

2.61799  (190.00  DEGREES  ) 
1.97202  (  90.07  DEGREES  » 
1.98*79  (113.72  DEGREES  ) 


RUN 


BEARING  ANGLE  EST 


ESTIMATED  STD  DEV 


1*9.998«0566*63*69 

.00095*28876970 

150.0009998885?07l 

.00097999567933 

150.0007611930627* 

.00115289776610 

1*9.9986*6*0391970 

.00079*2732*609 

150.0002065679591* 

.00092282309712 

1*9.99977508«02931 

.00109220807677 

150.000060*5*01009 

.00082969369678 

150.000P78693390*0 

.00093362162696 

150.00046679985503 

.00093216*92993 

10 

190.COC06981906109 

.00087328061614 

NEAN  • 

150.0000566532*261 

STD  DEV  • 

•0006775130*661 
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Table   16.1-G.     Sirnuldtion   estimates    at   li 


NU"fiEt    n«SE»V»TIONS 
STiNO*l»D    OEVtiTIOM 

NU**XE»    F'EOUENCIES 
OFG»EE    »'00E 
n"E    JITTEt 


$U«C4»t!Et    »«»LIT 
FPFOUENCt    (V*P    f») 
fBEOUEHCV    «SUPC»B) 
BOOULiTlPM    IMOEI 


•      102« 

THET»1  ■ 

■     .OOOiO 

TUFTI2  ■ 

10 

THETA3  ■ 

39 

>     OECtEF 

•        OFF 

■       1.00 

1.00 

•      30.00 

■    9960.00 

■      16.00 

3.14199  «1«0.00  OEStEFS  ) 
1,57202  (  00.07  OFG»EES  J 
1.96479    (113.72    DECVEES    ) 


(UN 


BEARIN6  ANCLE  EST 


ESTINlTfB  ?T0  OEV 


1 

2 
) 
4 
9 
6 
7 
0 
9 
10 

"EtN 

STD  OEV 


180.000 
179.999 
179,i;99 
179.998 
180.000 
179.998 
180. COO 
179.999 
180.001 
180.000 


27022980??! 
424*8995126 
71257f082«6 
263e768')083 
51959814118 
41136136729 
87626080131 
74042443228 
38923771174 
4l647540ng3 


179.99990245095978 
.00100765321683 


.0009 
.0010 
.0009 
.0009 
.0010 
.0011 
.0011 
.0010 
.0012 
.0009 


8121728795 
6176902454 
5223325261 

5369457388 
4133328262 

6657977919 
6634640279 
2227844207 

6099003859 
3685659427 


Table  15.1-H.  Simulation  estimates  at  210' 


NU»»»FB  OBSFpViTIPNS  • 

I       1024 

THETIl  ■ 

ST*NO*eO  DEVI»TrON   1 

•     .OC040 

TMET42  • 

NU»8E»  re  ?UMS       « 

10 

T"ET*3  • 

NU'BEB  FBEOUEHCIES   « 

38 

DEGREE  t^Cni                       1 

•     OFGBEE 

T!HE  JITTER          « 

•       OFF 

V»R  RH*SE  iNHIT     ■ 

•       1.00 

SUBCiSRIEB  i"RLIT    i 

•       1.00 

FBEOUENCY  (V»R  PHJ   I 

•      30.00 

FBEOUENCT  (^U8C»R)   ' 

■    9960.00 

NOOUi*TinN  INDE»     « 

•     16.00 

3.66519  (210.00  DEGREES  I 
1.57202  t  90.07  DEGREES  I 
1.98479  (11^.72  DEGREES  ) 


RUN 


BEtRINC  tN«LE  EST 


ESTIN4TE0  STO  OEV 


209.99968610688484 

,00117232677909 

210.00169319902129 

,00103879407391 

210.00138509685712 

,00104332572792 

210.00075030373227 

,00085433357839 

209,99977936434192 

,00105397423276 

210.00070856928414 

,00098892448788 

210.00153538982704 

,00081662641280 

210.00061107483816 

,00107337446024 

209.99768198440333 

.00102172874822 

10 

210.C0231368656478 

,00107614584471 

MEAN  • 

210.00061447759981 

STO  OEV  • 

.00131989054933 
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Table  16.1-1.  Simulation  estimates  at  240' 


NU"nE*  qnSEtVATIONS 
STANDtIO  OFVUTION 
NU"BE«  or   tUHS 
NUHBEt  F'FOUENCIES 
DECREE  MODE 
TIXE  JITTE* 


V«t  »H«SE  ANFlir 
SUOCAKtlEt  »»«niT 
FREOUENCT  (VAR  FH) 
FREOUE><CY  (SUBCAR) 
nOOULATION  INOEV 


xoih 

TMETAl  • 

.ooo«o 

THETA2  • 

10 

TMETA3  • 

%9 

DECREE 

OFF 

1.00 

1.00 

90.00 

9960.00 

16.00 

«.iaii79  (240.00  DECREES  I 
1.97?02  <  90.07  DEGREES  ) 
1.9a«79  (lis. 72  DECREES  I 


RUN 


BEARIH6  ANCLE  EST 


MEAN 
STD  OEV 


240.C012903S930949 
2S9.99879072B99099 
239.99910914601909 
240.00119432692746 
239.99990C9913M096 
240.00046941727934 
240.C0070129116737 
240.00l63e6S019fl07 
240.COC69038221900 
240.00067469649772 


240.00039719607230 
.00099194314991 


ESTIMATED  STD  DEV 

.00126233319997 
.00104321216620 
.00103016997900 
.00066904299264 
.00080969346617 
.00101669979694 
.00086373470628 
.00103492829297 
.00091499996220 
.00126760767647 


Table   16.1-J.     Simulation  estimates   at   270' 


NUMBER  OBSERVATIONS 

• 

1024 

THETAl 

STANDARD  DEVIATION 

.■ 

.00040 

THETA2 

NUMeER  OF  RUNS 

.• 

10 

THETA3 

NUMBER  FBfOMEHCIES 

.■ 

38 

DECREE  MODE 

.a 

0E6RFF 

TIME  JITTER 

■ 

OFF 

VAR  RMASE  AM»IIT 

• 

1.00 

SUBCARRIER  AMPLIT 

.■ 

1.00 

FRFOUENCV  (VAR  PH) 

■ 

30.00 

FREQUENCY  (SU^CAR) 

.■ 

9960.00 

NODUIATION  INDEX 

■ 

16.00 

4.71239  (270.00  DECREES  ) 
1.97202  (  90.07  OEGBEES  I 
1.96479    (113.72    DEGREES    ) 


RUN 


BEARING  ANCLE  EST 


1  270.00040220420691 

2  270.00140060647391 
9  270.00021990966096 
6  269.99919306230346 
9  269.99922214168199 

6  269.99942766246721 

7  269.99919627938471 
%  269.99914036323207 
f  270.00091763902997 

10  270.C0122291049991 


269.99999369913361 
•00067966711769 


ESTIMATED  STD  DEV 

.00069062261064 
.00116341132440 
.O00P698PO14943 
.00093418991992 
.00097760020999 
.00126991362416 
.00110962199669 
.00116160434629 
.00113022494941 
.0010!9337997a4 
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Table  16.1-K.  Simulation  estimates  at  300° 


HUW«E»    r%$EBW»TTONS    « 

•               102* 

THETll    ■ 

ST4M04I0    0EWT4TI0N      • 

•           .000*0 

THFT*2   • 

HU"I6»    Cf    «UHS                  « 

■                    10 

THFT43    - 

NU"BE«    F«E0U£NCIE8      « 

>                    38 

OFC«Ee    "POE                       « 

•          0E6IEE 

TI"E   JITTE*                       « 

1                 Off 

V»«    »M»SB    fHIT           1 

•               1.00 

SUBC*»tIEI    »«^11T       .• 

•               1.00 

FtEOUENCT    (V»»    PH)     .• 

•             30.00 

FtfOUENCY    ($UIC*»)      i 

•         9960.00 

MODULATION    INOEI           • 

•            .16.00 

9.23999  (300.00  OEC'EES  ) 
1.57202  (  90.07  OECtEES  ) 
1.98*79  C113.72  OEetEES  > 


tUN      lEARINfi  ANCLE  EST 

300.00016773029711 
299.999670609«6*5S 
300.C003*1973*366(> 
300.000960*87*3399 
300.0015910*910039 
299.999S68!e5193*9 
299.';999519«512907 
299.9999775l(t*7699 
299.99SC589*2*fe56 
300.0009130ft*»M099 


ESTIN4TED  STO  OEV 


NE4N 
STO  DEV 


300.00007019430632 
..00093735*37691 


.00088 
.00103 
.00109 
.00092 
.00108 
.00111 
.00087 
.00079 
.00106 
.00079 


997971036 
3**1*9901 
895229361 

9*138**90 
870233986 
7515619*1 
1*3692331 

582161163 
626070899 
^23132050 


Table  16.1-L.  Simulation  estimates  at  330°. 


NU"8E»    Q8^EBV«TtOHS    " 

•                102* 

THETAl 

STiNOABO    OEVIATIOH       ■ 

•           .000*0 

TMETA2 

NU"8E»    Pe    BUNS                < 

•                    10 

THETA3 

NUP-BEB    FBFOUENCIES       ' 

■                     3<l 

0E6BEE    "ODE 

•           0E6BEE 

TIKE   JITTEB 

•                   OFF 

VAt    BM4$E    AKPLIT           < 

1.00 

SU8CABBIEB    APiPLIT 

•                1.00 

FBEOUENCY    «VAt    PH) 

•             30.00 

FBEOUENCY    (SUBCAB)      i 

■        9960. CO 

•ODULATIPN    IHOEI           ' 

16.00 

9.75999  (330.00  DEGBEES  I 
1.97702  (  90.07  OEGBEES  > 
1.98*79  (113.72  OEC-BEES  I 


BUN 


BEABIN6  AN6LE  EST 


ESTIWATEO  STO  OEV 


MEAN 
STO  DEV 


330.000 
330.000 
329.998 
33C.C0C 
330.001 
329.999 
329.999 
329.999 
330.001 
329. Q99 


330.00027329607696 
.00077989232886 


.00100* 
.0009P9 
.00111* 
.001055 
.001127 
.00122* 
.001101 
.001070 
.0010*1 
.001003 


12*7692* 
83797783 
897018*9 
32956*92 

91309992 
78989201 
727962*2 
9919*876 
880276*8 
39566269 
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17.  System  Performance  and  Provisional  Uncertainty 

The  general  design  goal  of  the  VOR  measurement  system  was  to  achieve  an  overall  uncertainty  of 
±0.01°.  The  objective  of  tests  described  in  this  section  is  to  establish  a  statistical  model  which 
can  be  used  to  estimate  the  measurement  process  parameters  and  to  demonstrate  provisionally  that  the 
uncertainty  of  the  measurements  is  suitably  small  relative  to  the  allowable  error  limit.  Process 
parameters  are  quantities  which  characterize  the  behavior  with  regard  to  both  the  long-term  average  of 
the  process  and  the  inherent  variability  or  imprecision  of  the  process. 

The  complete  system  consists  of: 

(a)  a  standard  VOR  audio  generator,  which  is  used  to  calibrate  unknown  phasemeters; 

(b)  a  standard  VOR  phasemeter  for  the  calibration  of  unknown  generators; 

(c)  a  desktop  computer  which  controls  the  system. 

At  the  beginning  of  the  standards  development  effort,  it  was  decided  that  it  would  be  necessary 
to  design  both  the  standard  generator  and  standard  phasemeter,  since  otherwise  there  would  be  no  inde- 
pendent way  of  checking  either  one.  Thus  the  two  instruments,  which  work  on  different  principles,  are 
used  as  independent  checks  of  each  other.  Because  of  the  complementary  nature  of  the  two  services, 
the  procedure  to  assure  that  both  instruments  are  performing  as  desired  is  to  demonstrate  that  they 
agree  without  adjustment  to  either  one.  Other  objective  means  for  evaluating  the  performance  of  each 
instrument  independently  were  described  in  section  4. 

17.1  Systematic  Errors 

To  determine  the  uncertainty  of  a  measurement  process  one  must  quantify  both  systematic  and  ran- 
dom errors.  Possible  systematic  errors  related  to  both  of  the  standard  instruments  were  considered  in 
section  8.4.  For  each  potential  source  of  offset,  either  an  experiment  or  analytic  derivation  was 
described  to  show  that  the  upper  limit  of  systematic  error  was  negligible  relative  to  the  overall 
uncertainty  goal.  Therefore,  in  the  following  sections  we  focus  on  techniques  that  are   helpful  to 
establish  and  monitor  random  errors,  which  are  the  dominant  components  of  the  total  error  budget. 

17.2  Statistical  Model  for  Bearing  Measurements 

The  essential  characteristic  needed  to  establish  control  of  the  VOR  measurement  process  is  pre- 
dictability, i.e.,  the  variability  remains  at  the  same  level  and  the  process  average  is  not  drifting 
or  shifting  abruptly  from  its  established  values.  The  evidence  of  predictability  must  come  from 
redundant  measurement  of  process  parameters  over  a  full  range  of  operating  conditions.  Requirements 
for  obtaining  realistic  error  bounds  and  establishing  statistical  control  will  be  satisfied  if  the 
collection  of  measurements  is  from  a  sufficiently  broad  set  of  environmental  and  operating  conditions 
to  allow  all  potential  sources  of  random  error  to  influence  the  measurement  process. 

In  this  section  we  focus  on  a  statistical  model  which  facilitates  estimation  of  components  of  the 
total  process  variability  and  allows  the  implementation  of  statistical  control  procedures  for  the  pro- 
cess parameters.  The  model  is  sufficiently  general  to  distinguish  among  three  kinds  of  random  varia- 
bility that  may  contribute  to  the  total  process  variability: 
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(a)  short-term  variability   of   sequential    measurements   on   a  single   day; 

(b)  long-term  variability    (days,   months,   years); 

(c)  differential    levels   of   long-term  variability   depending  on   nominal    bearing   (switch)    settings. 

In   addition  to  these   components   of  total    process    variability,    potential    offsets   between  the  sig- 
nal   generator  and   phasemeter,   which  may   depend   on   bearing   angle,    can   be  estimated.     These  offsets 
between  the  two   instruments  will    be  used  to  obtain  a  heuristic   limit  on   possible  systematic  errors   for 
the  VOR   system.      In  the   section   17.3  we  describe   data  which  were   collected   to  shed   light   on  the   indi- 
vidual   contributions  to  the  total    uncertainty   of  the  process. 

The   statistical    analysis   for  quantifying  short-term  and   long-term  variability   in  VOR  bearing 
measurements   is   based   on  the  assumption  that  H   repeat  measurements   at  the   I   nominal    bearings   on  each 
of  J   occasions   can   be   described   by  the  model: 

y^j^,   =  u  +  o^    "^  "^j   "^  '^ij   "^  ^ijk'   ■i=l....,I;   j=l,...,J;    k=l,...,M 

where 

y^^l^     is  the  observed  deviation,  or  offset,  of  a  single  measurement  from  the  i^^  switch  setting, 

i.e.,  y  =  ( 6]_  -  nominal  bearing); 
u+QUj     is  an  unknown,  but  stable,  average  offset  of  measurements  at  the  i^  switch  setting,  i.e., 

u+oj  is  a  parameter  to  be  estimated  and  is  ideally  zero  for  any  i; 
T^      is  a  (possible)  random  shift  in  all  measurements  taken  on  the  j   occasion;  the  T^'s  are 

assumed  to  follow  a  Gaussian  probability  distribution  with  mean  zero  and  variance  aj  , 
D^^     is  a  (possible)  random  shift  on  the  j^  occasion  which  is  unique  at  the  i^^  switch  setting; 

the  D^-.-'s  are  assumed  to  have  a  Gaussian  distribution  with  mean  zero  and  variance  oq   ; 
e. -L.     is  the  short-term  random  error  of  measurement  in  the  k   repeat  measurement  at  switch  setting 


'i  jk 


i    on   occasion   j;   the  e^nu's   are   assumed  to  have  a 
Gaussian   distribution  with  mean   zero   and   variance   cr , 


The  statistical    analysis   of   bearing  angle  measurements   quantifies  the  individual    contributions  to 
the   VOR  process   variability   by   estimating  the   various   unknown   parameters   in  the  model.     To  be  speci- 
fic,  measurements   which   satisfy   the  model    have  the   following   properties: 

ECy^jk]   =   y  +  o^- 

VarCy^j^]   ^   oj^   +  oq^   +  c^ 

M 
E[(l/M)        I    y       ]   =   y  +  a. 
k=l     ^^'^  ^ 

M 
Var[(l/M)      I     y    .^]   =   0^2  +  ^^2  +  ^2/h 


k=l      'J 


J       M 

E[l 


1/JM)     I  I    y...J  =  u  +  a. 

j=l  k=l     ^^^  ^ 

J  M 

Var[(l/JM)      I  I     Y.  .,]   =    [a^^  +  a  2)/J   +  a^/JM, 

j=l  k=l     ^J^  '  ^ 
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where  E[«]  denotes  the  average  value  and  Var[«]  denotes  variability.  Statistical  analysis  of  the  VOR 

bearing  angle  measurements  provides  estimates  of  the  process  parameters  as  follows: 

J   M 
Limiting  Offset  at  Bearing  i:   p  +  a-  =  (1/JM)  I       )  y. ., 

^  i=l   k=l     ^^^ 


Standard  Error  of    (u  +  a.):      [(a-j-^  +  o^^)/J   +  o^/M] 


1/2 


Short-Term  Standard   Deviation    (Single  Measurement):      3 
Short-Term  Standard   Deviation    (Mean  of  M  Measurements   at   Bearing   i 


Total    Standard  Deviation    (Single  Measurement):      [a-.^  +  o^.^  +  o^ 
Total    Standard  Deviation   (Mean  of  M  Measurements   at   Bearing  i): 


1/2 


a2/M] 


+  a„2  +   o2/M) 


1/2 


For  each  measurement  y^ii^,  a   residual    6^-j|^   is   computed   from   6-    .^  =  y.    .^   -   ( u  +  a- )  •       These 
residuals   are  standardized  by  computing  t--.    =   <5- ./S(  6-  •.  ) ,  where  S(5i^i,)    is   an  estimate  of  the 

IJK  IJ  IJK  '  J'^ 

Standard  deviation  of  the   residual.     The   residuals   from  the  VOR  measurement   data   are   routinely   checked 
to  assure  the   validity  of  estimated  parameters   and  to  assess  whether  the  process   is   in   control.      In 
particular,   the   residuals   are  used  to  identify   and,    if   appropriate,   to   reject   individual    outliers   in 
the  data  set.     The  outlier   rejection  criterion  could  conceivably   flag  an  entire  day's  measurements 
that   are  out-of-control .     See   reference   5  for   a  discussion   of  outlier  detection  techniques. 


1        8      15     22     29      5 
MAR  APR 

1982 


12      19     26       3       10      17      24      31       7       14      21      28      5 

MAY  JUN  JUL 


12      19     26       2        9 
AUG 


Figure  17-lA.  Bearing  angle  offsets  at  0  degrees. 
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Figure  17-lB.     Bearing  angle  offsets   at   30  degrees. 
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Figure   17-lC.     Bearing  angle  offsets   at  60  degrees. 


52 


^. 


6    - 


73 

- 

<D 

d) 

4 

— 

i^ 

Q/) 

(V 

13 

p 

-1— H 

^       M^ 

^■^ 

•i-H 

S 

± 

+ 
+ 

0 

- 

"O^ 

- 

05 

1 

-2 

- 

1 
*-> 

■ 

-4 

- 

-6 


X 


_L 


1        8      15     22     29      5 
MAR  APR 

1982 


12      19      26      3       10      17      24      31       7       14      21      28      5 

MAY  JUN  JUL 


12      19      26      2        9 
AUG 


Figure  17-lD.  Bearing  angle  offsets  at  90  degrees. 
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Figure  17-lE.  Bearing  angle  offsets  at  120  degrees, 
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Figure  17-lF.     Bearing  angle  offsets   at  150  degrees. 
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Figure  17-lG.  Bearing  angle  offsets  at  180  degrees. 
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Figure  17-lH.  Bearing  angle  offsets  at  210  degrees. 
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Figure  17-11.  Bearing  angle  offsets  at  240  degrees. 
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Figure  17-10.     Bearing  angle  offsets  at  270  degrees. 
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Figure  17-lK.  Bearing  angle  offsets  at  300  degrees. 
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Figure  17-lL.  Bearing  angle  offsets  at  330  degrees. 
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Figure  17-lM.  Bearing  angle  offsets  at  360  degrees. 
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Table  17.1.  Measurement  occasions, 


Date  (1982; 


Measured  bearing 
angles  (degrees) 


Total 
No.  of  measurements 


March  4^5 
March  9 
March  12 
March  22 
April  29 
June  8 
July  6 
July  7 
July  13 
July  30 


30,  60,  ...,  360 

30,  60,  ...,  360 

30,  60,  ...,  360 

30,  60,  ...,  360 

30,  120,  180,  240,  300 

30,  120,  180,  240,  300 

30,  120,  180,  240,  300 

30,  120,  180,  240,  300 

30,  120,  180,  240,  300 

30,  120,  180,  240,  300 


70 
65 
75 
65 
30 
30 
30 
30 
30 
30 


17.3  Observed  Data  and  Plots 

An  ac  power  line  conditioner  was  added  to  the  VOR  system  in  February  1982.  It  handles  the  entire 
system:   generator,  phasemeter,  and  computer.  During  the  subsequent  period  of  operation,  data  were 
collected  on  10  separate  measurement  occasions  to  assess  the  stability  of  the  system,  to  estimate  pos- 
sible offsets,  and  to  validate  the  statistical  model  for  the  process.  Table  17.1  lists  the  dates  of 
these  measurement  occasions  and  notes  the  bearing  angles  which  were  measured  in  each  case.  At  each 
bearing  at  least  M=5  measurements  were  taken  in  succession,  with  each  measurement  requiring  about  5.5 
minutes  to  obtain. 

To  illustrate  both  the  offsets  of  the  process  from  the  nominal  bearings  and  the  short-  or  long- 
term  variability  of  the  measurements,  plots  of  the  data  are  shown  in  figures  17-1  A  through  17-1  M. 
The  value  plotted  on  the  vertical  axis  is  an  observed  measurement  minus  the  nominal  bearing  angle  in 
degrees.  Offsets  of  each  bearing  are  plotted  on  a  scale  from  -0.01°  to  0.01°. 

In  figures  17-1  E  (120°),  17-1  I  (240°),  and  17-1  K  (300°),  repeat  measurements  on  July  13  and/or 
July  31  exhibited  a  higher  short-term  variability  than  the  previous  history  of  the  process  would  sug- 
gest. However,  these  unexpected  cases  are  believed  to  have  been  caused  by  intermittent  thunderstorm 
activity  on  these  days.  For  this  reason,  some  of  the  measurements  were  discarded  in  the  statistical 
analysis  by  the  outlier  detection  procedure  discussed  below.  A  complete  listing  of  the  455  measure- 
ments, and  other  quantities  which  are  computed  by  the  VOR  system,  is  given  in  appendix  B. 
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17.4  Statistical  Analysis 

Because  of  the  complexity  of  the  analysis,  the  data  were  transmitted  to  a  CDC  170/750  computer 
where  parameter  estimates  were  computed  using  the  BMDP  statistical  software  package  [7].  In  this  sec- 
tion we  discuss  a  method  for  detecting  isolated  outliers,  or  uncharacteristic  measurements,  and  obtain 
estimates  of  the  parameters  in  the  statistical  model  for  the  VOR  system.  The  statistical  model  has 
been  found  to  describe  the  VOR  measurement  process  adequately  during  its  limited  time  of  operation. 

17.4.1  Detection  of  Outliers 

Two  types  of  individual  outliers  were  identified  in  the  set  of  455  measurements.  The  first  type 
is  flagged  by  excessively  large  values  (greater  than  0.005)  of  the  single  time-sample  standard  error 
of  a  bearing  measurement.  See  section  16.1  for  a  discussion  of  this  quantity.  At  present,  the  com- 
puted standard  error  is  not  a  reliable  measure  of  the  actual  short-term  random  error  in  bearing  meas- 
urements, but  this  is  thought  to  be  a  consequence  of  deficiencies  in  the  phasemeter  ADC,  which  fails 
to  meet  the  manufacturer's  specifications  for  linearity  by  about  a  factor  of  30.  Nevertheless,  the 
bearing  standard  error  is  a  useful  indicator  of  isolated  line  effects  during  individual  measurement 
periods. 

Outliers  of  the  second  type  were  identified  by  excessively  large  values  of  the  standardized 
residuals  when  the  statistical  model  was  fitted  to  the  data.  Standardized  residuals  were  denoted  in 
section  17.3  by 

t.  .,  =  6.  .^/S(6.  .,  ). 

The  statistical  software  which  was  used  automatically  computes  and  prints  the  t^  j^'s  for  the  model 
described  in  section  17.2. 

A  measurement  y^j|^  is  rejected  if  t^j|^  >  3.0  or  if  t^  [^  <  -3.0.  This  rejection  criterion  is 
motivated  by  the  observation  that  t^^|^,  though  its  exact  distribution  is  not  known,  is  similar  to  a 
Students-t  statistic.  The  critical  value  3.0  corresponds  to  the  0.995  probability  level  for  the  Stu- 
dents-t  distribution  with  35  degrees  of  freedom.  This  test  is  recommended  in  reference  4  as  a  good 
general  approach  even  though  probability  levels  cannot  be  computed  exactly. 

The  second  rejection  criterion  was  applied  to  the  data  set  three  times  iteratively  to  assure  that 
extreme  outliers  could  not  mask  the  effects  of  less  obvious  outliers.  Together,  the  two  outlier 
rejection  criteria  work  well  for  the  VOR  data  in  that  they  reject  those  measurements  which  appear  to 
be  unrepresentative  of  the  process  either  because  of  isolated  errors  in  the  amplitude  time-samples  or 
because  of  transient  effects  during  short  measurement  periods  (for  example,  thunderstorm  effects). 

In  the  future,  NBS  does  not  plan  to  conduct  calibrations  on  occasions  when  the  frequent  occur- 
rence of  uncharacteristic  measurements  could  perturb  the  results.  Aside  from  such  identifiable  tran- 
sient effects,  it  is  also  reasonable  to  reject  isolated  wild  measurements  before  estimating  uncertain- 
ties because  these  effects  do  not  substantially  influence  the  measurement  of  analog  phasemeters  which, 
by  design,  report  average  phase  over  many  cycles  of  the  generator. 
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17.4.2  Parameter  Estimates  and  Tests 

Estimates  of  the  unknown  parameters  were  obtained  by  a  statistical  maximum  likelihood  algorithm 
described  in  documentation  of  the  analysis  of  variance  program  BMDP3V  [7].  An  example  listing  of  the 
computer  output  corresponding  to  the  statistical  analysis  and  parameter  estimates  discussed  below  is 
given  in  appendix  D. 


Table  17.2.  Sample 

offsets  and 

standard  deviations. 

After 

Pass 

1 

After  Pass 

3  (final) 

Nominal 

Average 

Average 

bearing 

Count 

offset 

St.  dev. 

Count 

offset 

St.  dev. 

0 

49 

-0.00125 

0.00059 

49 

0.00125 

0.00059 

30 

48 

0.00049 

0.00071 

47 

0.00053 

0.00067 

60 

18 

-0.00074 

0.00042 

18 

-0.00074 

0.00042 

90 

20 

-0.00032 

0.00027 

20 

0.00032 

0.00027 

120 

48 

-0.00227 

0.00108 

44 

-0.00215 

0.00086 

150 

23 

0.00074 

0.00045 

23 

0.00074 

0.00045 

180 

56 

-0.00195 

0.00042 

56 

-0.00195 

0.00042 

210 

20 

-0.0G162 

0.00041 

20 

-0.00162 

0.00041 

240 

48 

0.00008 

0.00106 

44 

-0.00012 

0.00065 

270 

18 

-0.00092 

0.00049 

18 

-0.00092 

0.00049 

300 

50 

0.00041 

0.00089 

46 

0.00029 

0.00053 

330 

20 

-0.00077 

0.00032 

20 

-0.00077 

0.00032 

360 

20 

-0.00061 

0.00027 

20 

-0.00061 

0.00027 

Total 

438 

425 

Of  the  total  set  of  455  measurements  taken  at  13  distinct  bearing  angles,  30  measurements  (6.5 
percent)  were  rejected  as  outliers  by  the  two  rejection  criteria.  Table  17.2  lists  the  observed  aver- 
age offset  at  each  bearing  angle  and  the  corresponding  sample  standard  deviation  after  first  and  third 
(final)  iterative  application  of  the  second  rejection  criterion.  Recall  that  a  total  of  three  passes 
were  made  in  the  analysis  to  flag  outliers. 

The  standard  deviations  listed  in  table  17.2  were  computed  using  only  the  data  for  a  particular 
bearing  and,  therefore,  neither  partition  the  variability  into  short-term  and  long-term  contributions, 
nor  do  they  reflect  the  fact  that  all  bearings  are  incorporated  simultaneously  in  the  statistical 
model.  Table  17.2  has  been  included  to  illustrate  in  a  simple  fashion  the  magnitudes  of  the  offsets, 
their  overall  variability,  and  the  effects  of  the  outlier  detection  procedure  on  descriptive  statis- 
tics. 

The  statistical  analysis  for  the  model  described  in  section  17.2  was  used  to  estimate  the  offsets 
at  each  bearing,  and  to  partition  the  total  variability  into  components  for  both  short-  and  long-term 
variations  (see  section  17.2).  Because  the  data  are  not  evenly  distributed  among  bearings  or  days, 
the  maximum  likelihood  estimates  of  offset  could  differ  slightly  from  the  observed  (simple)  average 
offsets.  Table  17.3  lists  the  final  estimated  offsets  (through  July  30,  1982)  of  the  VOR  process  and 
the  estimated  random  uncertainty  in  these  estimates.  We  have  included  the  corresponding  estimates 
from  the  analysis  after  the  first  pass  to  reject  outliers.  Sample  counts  are  given  in  the  previous 
table. 
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Table  17.3.  Estimated  offsets  and  standard  errors, 


After  Pass  1 


Nominal 
Bearing 


Estimated 
offset 


St.  Dev. 
of  estimate 


Final  Values  (7-30-82) 
Estimated  St.  Dev. 

offset  of  estimate 


0 

30 
60 
90 

120 
150 
180 
210 
240 
270 
300 
330 
360 


-0.0013 

0.0005 
-0.0009 

0.0002 
■0.0023 

0.0005 
-0.0020 
■0.0018 

0.0001 
■0.0010 

0.0004 
■0.0009 
■0.0008 


0.0002 
0.0002 
0.0002 
0.0002 
0.0002 
0.0002 
0.0002 
0.0002 
0.0002 
0.0002 
0.0002 
0.0002 
0.0002 


-0.0013 

0.0005 
-0.0009 

0.0001 
-0.0022 

0.0005 
-0.0020 
-0.0018 
-0.0001 
-0.0011 

0.0003 
-0.0010 
-0.0008 


0.0001 
0.0001 
0.0002 
0.0002 
0.0001 
0.0002 
0.0001 
0.0002 
0.0001 
0.0002 
0.0001 
0.0002 
0.0002 


We   remark  that   slight  differences   in  the  standard  errors   of  the  final    estimated  offsets   reflect 
the  fact  that   some  bearings  were  measured  more  often  and  therefore  have  a   lower  uncertainty.     That 
this   difference  is   not   apparent   after  the  first   pass   for  outlier   rejection   is   an   indication   of  the 
influence  of  outliers  on  the  estimated  components  of  total    variability. 

In  the  analysis  which   gave   rise  to  the  parameter  estimates   given   in  table   17.3,  we  simultaneously 

1/2 
obtained  estimates   of  the  short-term   (a)   and  long-term   (oj^  +  0,2)         standard  deviations.     Table   17.4 

gives   estimates   of  a  few  functions  of  these  components  which  are  used  to  establish   limits  to   random 

errors.     The  effects   of  outliers   on  estimation  of   variability  are  more  clearly  evident   in  the 

tabulated  comparison  between  the  first  and  final   passes  through  the  data. 

The  maximum  likelihood  technique  also  provides   a  statistical    test   based  on  the  Chi-square  distri- 
bution to  determine  if  the  two  long-term  components  of  variability   (and,   so,   the  corresponding  terms 
in  the  statistical   model)   are  necessary  to  characterize  the  VOR  process.     Non-negligible  contributions 
to   variability  are  indicated  by  a  small    value   (<  0.05)   of  the  significance  level    for  the  Chi-square 
test   statistic  computed  by   the  software.     Table  17.5  gives  the   results  of  these  tests   for  the  final 
data  set,   and   indicates  that   both   long-term  components   are  non-zero.     We  also  list  the  estimated   stan- 
dard deviations   of  the  estimated   variance;   however,   the  Chi-square  test   statistic  is   not  computed 
simply   from  the  quantities   listed. 


Table  17.4.     Components   of   random  error. 


Description  of 
random  error 


Quantity 
estimated 


After  Pass   1 
estimate 


Final    (7/30/82) 
estimate 


Short-term  st.   dev. 

Total    St.   dev. 

Short-term  st.   dev.    (mean 
of  5  readings   at   1  bearing) 

Total    St.   dev.    (mean  of  5 
readings   at   1   bearing) 


(a2+aj2+0u2)i/2 
(a2/5)i/2 

(a2/5+aj2+oj^2)l/2 


0.0006 
0.0007 
0.0003 

0.0005 


0.0004 
0.0006 
0.0002 

0.0004 
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Table  17.5.  Chi-square  tests  for  contributions  to  random  error  (7-30-82). 


Standard 

Chi 

-square 

Degrees 

Signi- 

Parameter 

Estimate 

deviation 

test 

statistic 

of  freedom 

ficance 

o2 

1.775x10"^ 

0.137x10-7 

"T^ 

0.518x10-7 

0.306x10-7 

7.942 

1 

0.005 

°d' 

0.916x10-7 

0.209x10-7 

54.030 

1 

0.000 

17.5  Overall  System  Performance 

In  the  previous  section  we  obtained  estimates  of  individual  offsets  between  NBS  standard  gener- 
ator and  standard  phasemeter  at  13  nominal  bearings  which  are  thought  to  be  representative  of  the  sys- 
tem behavior  over  the  full  range  of  0°  to  360°.  We  also  computed  reasonable  estimates  of  various  com- 
ponents of  random  variability  about  these  offsets.  In  this  section  we  characterize  the  overall  system 
performance  by  computing  the  limits  to  random  error  in  the  reported  values  of  the  individual  offsets. 
This  information  about  the  system  performance  at  13  distinct  bearings  has  been  combined  into  a  single 
provisional  uncertainty  statement,  which  is  reported  in  the  following  section. 

The  limit  to  random  error  associated  with  the  i-th  bearing  offset  is  3s^,  where  s^  denotes  the 
estimated  standard  deviation  of  the  reported  offset  (see  table  17.3).  Recalling  that  the  estimated 
offset  at  bearing  i  was  denoted  by  p  +  a^ ,  then  statistical  bounds  on  the  offsets  are  given  by 

y  +  ouj  ±  3s^  . 

All  of  the  required  quantities  are  documented  in  table  17.3.  The  estimated  bounds  on  offsets  at  the 
13  measured  bearings  are  reported  below  in  table  17.6.  Note  that  in  each  case  the  maximum  limit  in 
magnitude  of  the  offset  is  less  than  the  allowable  uncertainty  of  ±0.01°. 

Table  17.6  Overall  system  performance. 

Nominal  bearing  Lower  limit  Estimated  offset  Upper  limit 

0  -0.0016  -0.0013  -0.0010 

30  0.0002  0.0005  0.0008 

60  -0.0015  -0.0009  -0.0003 

90  -0.0005  0.0001  0.0007 

120  -0.0025  -0.0022  -0.0019 

150  -0.0001  0.0005  0.0011 

180  -0.0023  -0.0020  -0.0017 

210  -0.0024  -0.0018  -0.0012 

240  -0.0004  -0.0001  0.0002 

270  -0.0017  -0.0011  -0.0005 

300  0.0000  0.0003  0.0006 

330  -0.0016  -0.0010  -0.0004 

360  -0.0012  -0.0006  -0.0000 
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17.6  Provisional  Uncertainty 

At  the  outset  of  this  report  it  was  noted  that  the  primary  criterion  for  judging  the  performance 
of  the  two  VOR  instruments  was  to  achieve  a  high  degree  of  confidence  that  they  agree  with  each  other. 
That  is,  since  they  are  independent  and  work  on  different  principles,  it  is  probable  that  their  sepa- 
rate indications  are  accurate  if  the  nominal  setting  on  the  generator  agrees  with  a  measurement  by  the 
phasemeter. 

Because  the  reported  offsets  between  the  generator  and  phasemeter  cannot  be  attributed  wholly  or 
in  part  to  either  instrument  at  this  time,  it  was  decided  to  combine  the  information  in  table  17.5 
into  a  single  provisional  uncertainty  statement  for  either  instrument  alone.  Therefore,  until  indivi- 
dual error  analyses  are  devised,  or  until  international  comparisons  are  conducted,  NBS  will  use  the 
estimated  maximum  absolute  offset  in  the  group  of  13  bearings  as  the  systematic  error  for  either  VOR 
instrument,  and  will  report  the  nominal  bearings  as  accepted  values  for  the  process.  The  limit  to 
random  error  is  three  times  the  maximum  standard  deviation  of  the  estimated  offsets  in  table  17.3. 

The  uncertainty  of  VOR  bearing  calibrations  is  given  by: 

The  assigned  values  of  VOR  phase  angles  are  the  nominal  hearings  from  0  to  360°  in  incre- 
ments of  0.01°  .  The  overall  uncertainty  of  these  values  has  heen  estimated  from  test  data 
at  hearings  from  (f  to  360°  at  30°  increments.  Thus,  each  of  the  nominal  hearings  has  heen 
assigned  a  provisional  overall  uncertainty  of  ±0.0028° ,  hased  on  estimated  hounds  of 
±0.002^    on  the   systematic  error  and  a  computed  standard  error  of  0.0002° . 

18.  Process  Control  and  Updating  Parameters 

In  sections  17.4  and  17.5,  initial  accepted  values  of  VOR  process  parameters  were  obtained.  Once 
these  parameters  have  been  established,  overall  process  control  is  maintained  by  checking  the  observed 
short-term  standard  deviation  and  estimated  offsets  on  each  subsequent  measurements  occasion  against 
their  accepted  values.  As  long  as  the  process  produces  values  which  are  consistent  with  the  accepted 
parameter  values,  the  system  is  considered  to  be  performing  within  the  established  control  pattern. 
Procedures  for  detecting  out-of -control  conditions  are  discussed  briefly  below,  but  procedures  for 
identifying  and  correcting  specific  malfunctions  from  the  various  statistical  tests  are  evolving  as 
more  experience  is  gained  with  the  VOR  system  and  will  not  be  discussed  here. 

18.1  Control  Charts  and  Tests 

Control  charts  are  used  on  a  continuing  basis  to  monitor  the  output  of  the  composite  VOR  measure- 
ment system.  Given  established  values  for  process  parameters,  the  estimated  offsets  and  short-term 
standard  deviations  on  subsequent  calibration  dates  are  plotted  against  a  time  scale.  The  charts  for 
offsets  includes  control  limits  so  that  an  out-of-control  value  is  immediately  noticable.  The  chart 
of  the  short-term  standard  deviations  provides  visual  evidence  to  determine  if  there  has  been  a  change 
in  the  within-day  process  variation. 

The  short-term  variation  on  a  given  measurement  occasion  can  be  estimated  by  describing  the  data 
using  a  special  case  of  the  statistical  model  given  in  section  17.2.  If  M  repeat  measurements  are 
made  at  I  nominal  bearings  the  model  for  the  measurements  is: 
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y^j  =  y  +  a.  +  e.j,   i  =  1,  •  •  •,  I; 

J  =  1,  •  •  •,  M; 

where 

y^- ^      is  an  observed  offset  [Q-^   -   nominal  bearing]; 

y  +  Oj    is  the  unknown  average  offset  at  bearing  i  for  the  current  day; 

e^^      is  the  short-term  error  of  measurement  in  the  j-th  repeat  measurement  at  bearing  i. 
The  errors,  e^ ^ ,  are  assumed  to  have  a  Gaussian  distribution  with  mean  zero  and  variance  cr.  If  the 
process  is  in  statistical  control,  the  current  estimated  short-term  standard  deviation  and  the  esti- 
mated offsets  should  be  consistent  with  the  accepted  values  of  these  parameters. 

The  statistical  analysis  obtains  the  parameter  estimates  after  outliers  have  been  rejected  by  the 
methods  discussed  in  section  17.  These  estimates  are  then  plotted  on  the  control  charts  and  are  also 
used  in  statistical  tests  to  determine  whether  or  not  the  process  is  in  control. 

18.1.1  Control  Chart  for  Short-Term  Error 

Figure  18-1  illustrates  the  within-day  process  variation  for  17  measurement  occasions  from 

March  1,  1982  through  May  6,  1983.  The  first  10  estimated  values  of  a  were  obtained  from  the  data 
used  to  establish  the  current  accepted  values  of  the  process  parameters.  For  reference,  the  accepted 
value  of  a   is  also  noted  in  the  figure.  The  inclusion  of  estimates  from  data  obtained  on  July  30, 
1983  serves  to  illustrate  that  the  unusually  high  short-term  variation  on  July  30  was  apparently 
caused  by  thunderstorm  activity  on  that  day.   In  the  next  four  figures,  open  circles  are  used  to 
indicate  data  used  in  arriving  at  the  estimate  and  control  limits  (if  present).  Plus  signs  (+)  are 
used  to  indicate  data  taken  after  the  estimates  were  made. 

18.1.2  Control  Chart  for  Individual  Measurements 

Sufficiently  accurate  control  limits  cannot  be  established  during  the  current  stage  of  initiating 

the  VOR  measurement  process.  However,  to  illustrate  the  type  of  control  charts  which  will  be  used  to 
monitor  the  process  after  a  large  number  of  calibration  occasions  have  been  inspected,  some  of  the 

data  used  to  compute  process  parameters  are  plotted  in  figures  18-2  A-F. 

During  start-up  the  process  is  assumed  to  be  in  statistical  control.  The  control  limits  in 
figures  18-2  A-F  will  be  used  until  evidence  is  obtained  which  is  not  consistent  with  the  accepted 
values  or  until  enough  data  accumulates  to  effectively  revise  or  update  the  process  parameters. 

Although  charts  on  the  average  offsets  are  more  sensitive  than  those  on  individual  measurements, 
the  latter  was  chosen  because  outlier  rejection  may  result  in  unequal  numbers  of  repeat  measurements 
from  occasion  to  occasion.  Thus,  fluctuating  control  limits  would  be  required  for  charts  on  the  aver- 
age offset. 

Limits  specified  in  figures  18-2  A-F  were  set  at 

G  +  ii  ±  3(a2  +  ;y2  +  ;q2)i/2, 

where  the  estimates  of  the  offset  at  the  ith  bearing  and  the  components  of  error  are  the  initial 
accepted  values.  The  numeric  values  were  given  in  tables  17.3  and  17.4. 
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Figure   18-1.     Control    chart   for  short-term  standard  deviation. 
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Figure   18-2A.     Control    chart   of  offsets   at  0  degrees. 
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Figure   13-2B.     Control    cnart   of  offsets   at   30  degrees. 
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Figure   18-2C.     Control    chart  of   offsets   at   120  degrees. 
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Figure   18-20.     Control    chart   of   offsets    at   180  degrees, 
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Figure   18-2E.     Control    chart  of   offsets   at  240  degrees, 
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Figure  18-2F.  Control  chart  of  offsets  at  300  degrees. 

18.1.3  Tests  for  Out-of -Control  Conditions 

Two  types  of  statistical  comparisons  are  used  to  determine  if  process  parameters  may  have  changed 
since  previous  calibration  sessions.  These  tests  monitor,  respectively,  the  process  short-term  varia- 
tion and  the  mutual  offsets  between  generator  and  phasemeter.  Table  18.1  illustrates  the  procedure 
and  shows  the  appropriate  statistical  tests  for  comparing  current  offsets  to  accepted  values.  Table 
18.2  describes  the  test  for  an  increase  in  short-term  variation. 

Tables  18.1  and  18.2  are  presented  primarily  to  illustrate  the  procedures  which  are  used  to 
determine  if  the  process  parameters  may  have  changed  from  the  accepted  values.  However,  it  is  clear 
from  the  results,  which  are  based  on  actual  measurements,  that  values  of  the  components  of  random 
error  should  be  recomputed  when  more  process  output  is  available.  This  is  also  suggested  by  visual 
evidence  in  the  control  chart  in  figure  18-1,  which  seems  to  indicate  that  an  abrupt  shift  in  short- 
term  variation  may  have  occurred  between  June  8  and  July  6.  If  the  larger  error  persists  and  the  pro- 
cess remains  within  the  assigned  goal,  new  values  of  the  parameters  will  be  determined  from  measure- 
ments obtained  after  June  8,  1982. 
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Table  18.1.  Comparison  of  new  offsets  to  accepted  values, 


Nominal 
bearing 


Accepted 
offset 


Estimated 

offset  on 

9/28/82 


Number 
observed 


Estimated 
Std.  Dev. 
of  offset 


t-Test 


SU) 


y)/s(y) 


0 
30 
120 
180 
240 
300 


0.0013 

-0.0018 

0.0005 

0.0001 

0.0022 

-0.0033 

0.0020 

-0.0022 

0.0001 

-0.0006 

0.0003 

0.0008 

2.7342  X  lO"'* 

-2.19 

3.0569  X  10-'+ 

-1.31 

2.7342  X  lO""* 

-4.39- 

2.7342  X  10-^ 

-0.73 

2.7342  X  10"'^ 

-1.83 

2.7342  X  lO""* 

1.83 

*If  t  >  3,  the  new  value  is  not  consistent  with  the  accepted  offset.  In  this  case  a  malfunction  which 
affects  120°  (or  possibly  a  range  of  bearings)  may  be  indicated. 


Accepted 

short-term 

variance 


Table  18.2.  Comparison  of  new  short-term  variability  with  accepted  value. 


Estimated 

variance  on 

9/28/82 


Total 

number  of 

measurements 


Number  of 
bearings 


Chi -square  (x^) 
test 


a2 

S2 

N 

k 

(N  -  k)s2 
a2 

1.775  X  10-7 

3.738  X  10-7 

29 

6 

48.44* 

*If   x^   ^  X^         fof"   i^  -  k)   degrees  of  freedom,   the  current   short-term  variability  is   not  consistent 


(2 

O'Ol 


with  the  accepted  value.  For  23  degrees  of  freedom,  y^    "^  9.26. 

0'  01 


Finally,  we  remark  that  the  t-test  and  chi-square  test  were  applied  assuming  that  the  accepted 
values  of  the  process  parameters  were  "known,"  or  at  least  very  precisely  determined  relative  to  the 
estimates  obtained  on  the  subsequent  occasion.  These  tests  will  be  appropriate  when  the  process  has 
been  shown  to  be  in  continous  statistical  control  for  several  measurement  occasions,  so  that  highly 
accurate  values  of  the  process  parameters  can  be  established  from  the  combined  data.  During  the  pre- 
sent stage  of  initiating  the  process,  or  during  the  start-up  of  the  process  after  a  substantial  system 
modification  or  other  out-of-control  process  correction,  it  will  be  necessary  to  use  tests  which 
incorporate  and  adjust  for  uncertainty  in  the  initial  accepted  values.  The  appropriate  initial  com- 
parisons are  an  F-test  for  short-term  error,  and  the  two-sample  t-test  for  offsets. 

18.2  Updating  Process  Parameters 

Initial  accepted  values  for  the  VOR  system  were  established  after  10  calibration  runs  from 
March  3,  1982  through  July  30,  1982.  On  subsequent  occasions,  the  process  is  monitored  using  the  con- 
trol procedures  described  above  to  determine  if  measurements  are  adequate  relative  to  the  assigned 
uncertainty  goal.  Generally,  this  procedure  may  be  followed  as  long  as  the  process  is  confirmed  to  be 
performing  within  the  established  control  pattern. 

Periodically,  as  data  accumulate  at  the  control  bearings,  new  accepted  values  for  offsets  and 
components  of  error  will  be  computed  by  combining  current  data  with  previous  measurements  and  applying 
the  methods  described  in  section  17.4.  Initially,  the  accepted  values  will  be  updated  after  five  or 
six  calibration  runs  and  then  as  convenience  dictates  (every  six  months  or  yearly). 
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18.3     Procedures   for  Correcting  Out-of-Control    Conditions 

Actions  which   can   be  taken  when  a  statistical    test   indicates   an   out-of-control    condition  are  cur- 
rently  being  investigated.      In  the  absence  of   specific  assignable  causes   for  out-of-control    condi- 
tions,  the  following  general   questions  will    be  considered. 

If  the  process   is   found  to   be   out   of  control    by   a  chi-square   or  F-test,    indicating  excessive 
short-term  nonrepeatabi 1 i ty: 

1.  Was   there  extreme  weather  activity  during  the  calibration   run    (thunderstorms,   wind,   etc.)? 

2.  Is  the  accepted   value  of   short-term  error   realistic? 

3.  Has   the  process   variation   changed?     Is  the  current   variation   still    adequate  for  the  assigned   goal? 

4.  Is   there  unusual    activity   in  the  laboratory  or  building  affecting  power  supplies? 

5.  Equipment   deterioration  or  minor  malfunction? 

If  the  process   is   found  to  be  out  of  control    by  a  t-test,   indicating  an  abrupt   shift   in   bearing: 

1.  Only   at  a  single  bearing?     This  may  indicate  an   intermittent  or  transient  external   disruption. 

2.  At  several  control  bearings?  Look  at  bearing  histories  for  a  steady  drift  toward  out-of-control 
condition.  This  could  indicate  a  need  for  system  adjustment.  If  an  abrupt  change  has  occurred, 
this   could   indicate  a  component  malfunction   in  either  the  generator  or  in  the  phasemeter  ADC. 


The  work   reported  here  is  the   result   of  vital    contributions   by   several    persons   over  a  period  of 
about   five  years.     M.   G.   Arthur  provided  the  initial    project  management.     He  and  C.   H.   Manney,   Jr., 
determined  that   the  use  of  primarily   digital    techniques   in   both   the  phasemeter  and  generator  was  the 
only   approach  that   could  achieve  the  desired  accuracy.     G.   R.   Sugar  and  C.   J.   Roubique  did  most   of  the 
detailed   logic  design   in  the  generator,   and   E.   Niesen   constructed   and   assisted   in  debugging   it.     The 
phasemeter  was   designed  and  constructed  by   N.   T.   Larsen,   and  the  software  was  written   by  Larsen  and 
0.   F.   Vecchia. 

The  task   of  completing  the  development,   verifying  the  performance,   and  writing  this    report   fell 
to  the  present   authors.     The  credit  for  the  design   belongs  mainly  to  those  named  above;   the  authors 
however,   take  full    responsibility  for  preparing  this   report. 
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Appendix  A.     VOR   Phasemeter   Prografn  Listing 


Rev$="8207140822" 

Di  sk$=" " 

Filenanie$="VORl" 
8201011453:  Adde 
This  program  tak 
form  and  stores 
venter  and  the  t 
this  program  can 
the  processing  a 
results   and   stat 


!   This  must   be  a   10-digit   number. 
!   A  10-digit   no.   picked  up   from  the  disk, 
!    Filenames   is   this   program's   name, 
d  year  to  Time$.     Added  MATPRINT  Theta  to  Meas_print. 
es   1024  time   samples   of  the  VOR  composite  audio  wave- 
the  data  on   disk.      It   drives   the  analog-to-digital    con- 
ime  delay   generator.     After  the  data  have  been   stored, 
retrieve  and  process   the  file.     The  final    results   of 
re  then   stored  in  the  original    file.      (Intermediate 
i sties   on   sets   of  measurements   are   not   stored.) 


A  single  measurement    results    in   one   file,    17   records   of   256   bytes   each. 
The  first   16   records   are  completely   filled  by  the   1024  integer  pre- 
cision  data  points.     The   last   record   is  completely  filled  by  a  32- 
element   array  used   for  housekeeping  purposes. 

This   program  has   been  tested  using  simulated,   noisy  data.     To  process 
simulated  data,   3  changes   should   be  made: 

1.  Check  that   the  sine  transforms   are   not   negated  in   Fft_driver, 
line  Changel. 

2.  Do  not   MAT   READ  Housekeepi ng(*)    in   Retrieve_data,   line  Change2, 

3.  Delete  the   PAUSE   in   Retrieve  data,    line  Change3. 


Rev$  and  Disk$  are  stored   in   Housekeeping(6)   &   (7),    respectively. 
They  are  the  code   revision  date  and  the  disk   identification,   and  are 
used  in  documenting  printed  output. 

Sine  transforms  negated,  8005280905. 

Routine  Fft  uses  code  adapted  from  the  Hewlett-Packard  9835  Numerical 
Analysis  software  package. 


Arrays  used  in  the  Estimation  subroutine:  Qd( 


Xt( 


Theta(*) 


Arrays  used  in  the  Xt  subroutine  are  dimensioned  by  label  Xt_dim:. 
This  line  is  disabled  to  conserve  25  kbytes  of  memory. 

Integer_data(*)=integer  precision  time  series  data,  the  raw  output 
of  the  A/D  converter.  This  is  the  data  stored  on  disk;  integer 
precision  data  takes  less  disk  space. 

Real_data(*)=the  full  precision  array  into  which  the  data  is  loaded 
from  disk  for  FFT  processing.  As  stored,  it  is  integer  data,  but 
before  it  is  processed,  it  is  converted  to  volts  by  multiplying 
by  5/32768. 
To  convert  to  volts,  multiply  by  5/32768. 

Housekeeping(*)  holds  the  following  elements: 

1:  Ending  date-time   group    (dtg)   of  a  data   run:   Time_no. 

2:  Nominal    bearing  angle,   degrees:    Nom_bearing. 

3:  Number  of  measurements   in  the  set:    No_measmnts. 

4:  Number  of  this   measurement:    Measmnt. 

5:  Number  of  data  points   in  the  set  taken   in  overload   (bad). 

6:  Revision   dtg  of   the  code:    VAL(Rev$). 

7:  Disk  dtg:    VAL(Disk$). 

8:  File_no   of  the  measurement,    DATnnn. 

9:  Thetal,  the  VOR  bearing  angle  (=0  if  data  not  processed). 

10:  Theta2 

11:  Theta3 

12:  Sigmasq,  a  measure  of  the  precision. 

13:  Est_std_dev,  the  estimate  of  the  standard  deviation. 

14:  Processed,  a  flag  that  identifies  processed  data. 
15 

32:  Unassigned  (=0)  for  future  use.  May  be  used  for  customer  ID, 
instrument  ID,  last  recalibration  dtg,  etc.  See  label  House- 
keepi ng. 
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1420 
1440 
1460 
1480 
1500 
1520 
1540 
1560 
1580 
1600 
1620 
1640 
1660 
1580 
1700 
1720 
1740 
1760 
1780 
1800 
1820 
1840 
1860 
1880 
1900 
1920 
1940 
1960 
1980 
2000 
2020 
2040 
2060 
2080 
2100 
2120 
2140 
2160 
2180 
2200 
2220 
2240 
2260 
2280 
2300 
2320 
2340 
2360 
2380 
2400 
2420 
2440 
2460 
2480 
2500 
2520 
2540 
2560 
2580 
2600 
2620 
2640 
2660 
2680 
2700 
2720 
2740 
2760 
2780 


DelayS=5359A  command  string. 

!(*)  See  R(*) ,  below. 

Jn(*)  Holds  tne  values  of  Bessel  functions  of  the  first 

kind,  orders  -18  througn  18  (37  numbers).  Loaded  with  file  "Xt", 


Meas(*) 
abou 
cont 

(i. 

rows 

1. 


2. 
3. 

4. 


is  organized  as  follows:  Tne  first  row  contains  information 
t  the  30  Hz  fundamental  frequency,  and  rows  2  through  38 
ain  the  same  information  for  spectral  lines  314  through  350 
e.,  lower  sideband  -18  through  upper  sideoand  no.  18).  All 
of  Meas(*)  conform  the  these  column  assignments: 
Real  part  from  R(*)--note  that  the  rows  do  not  correspond. 
The  first  row  of  Meas(*)  results  from  tne  second  row  of  R(*] 
I(*);  etc. 

Imaginary  part  from  I(*)--same  rows  as  aoove. 
Magnitude  or  amplitude  of  the  lines. 
Phase,  in  radians,  after  selection  of  quadrant 
placed  in  Qr(*),  for  use  in  the  estimation  of 
Phase,  in  degrees,  derived  from  col.  4.  This 
in  Qd(*),  which  is  used  in  the  bearing  angle  e 
SGN  of  Jn(Row-20),  the  sign  of  Bessel  function 
Pointer("*')  value  for  that  row.  The  value  is  o 
tne  harmonic  number. 


.  This  col .  is 
the  std.  dev. 
col .  is  placed 
stimation. 
s  -18  to  18. 
ne  greater  than 


Pointer(*)  is  set  up  in  the  FFT  driver  to  indicate  tne  desired  lines  in 
R(*)  and  I(*);  only  lines  1  and  314-350  are  used. 

Qd(*)  is  a  vector  =  to  col.  5  of  Heas(*).  Angles  have  been  ordered. 

It  is  used  in  the  estimation  of  the  bearing  angle,  Theta(l,l). 

Qr(*)  is  a  vector  =  to  col.  4  of  Meas(*).  Angles  are  never  ordered. 
It  is  used  in  the  estimation  of  the  standard  deviation  of  the  bear- 
ing angle,  Est_std_dev.  This  estimation  helps  identify  bad  data. 

R(*)  holds  the  odd-numbered  rows  of  Data(*);  I(*)  holds  the  even-num- 
bered rows.  R(*)  and  I(*)  are  used  in  the  FFT  routine.  Conversion 
from  Data(*)  to  R(*)  and  I{*)  only  requires  4  seconds;  but  if 
memory  is  severely  limited,  the  code  can  oe  changed  to  store  tne 
data  directly  in  R(*)  and  I(*).  Otherwise,  storing  the  data  in  a 
single  array  simplifies  possiole  future  processing. 

In  tne  FFT,  the  elements  in  botn  R(*)  and  !{*)  are  replaced  by  the 
real  and  imaginary  parts  of  tne  lines.  The  first  row  in  R(*)  con- 
tains the  DC  term  and  the  first  row  in  I(*)  contains  the  maximum 
frequency. 

Meas(38,7)  [q .  v.]  selects  the  needed  lines  from  R(*)  &   I(*)  by 

means  of  Pointer(*). 

Results!*)    nolds   the   bearing   angles   for   all    measurements,    up  to   50  in 
one  set.     This   may  be   reduced  to   conserve  memory,   since  an  estimate 
of  the   standard   deviation   of  the   bearing  angle   can   be  obtained  from 
only   one   measurement.      (It  tends   to   be   overly   conservative.) 

Stats(*)    replicates   Results(*)    and   is   then   used   to   compute  mean,    s.d., 
etc,   to  preserve  Results (*),    if   needed.     Memory  may   be   saved   by 
allowing   Results(*)    to   be   altered   in  the  processing,   otherwise. 

Tneta(*)    contains   the   estimates   of  the  three    (tneta)   angles    in   the 
model    of  the   VOR   signal.     Theta(l,l)    is   the   estimated   bearing 
angle. 

Mai n_program:      ! 
OPTION  BASE   1 

COM  REAL   Xt(3, 38), Jn(37),Pointer(38),Ck, Years 

DIM  Real_data ( 1024, 1 ),  Del  ay S[80], Housekeeping (32), I ( 512), Meas( 39, 7) 
DIM   R( 512), Results (50,1), Stats (50,1) 
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2800  DIM  Qd(38,l),Qr(38,l),Theta(3,l) 

2820  DIM  X(37),Y(37),Xsq(15),Ysq(15),Xy(15) 

2840  INTEGER  Integer  data{1024,l) 

2860  Xt_dim:!  DIM  X{38,T)  ,V(38,38) ,Vi (38,38) ,A(38,3) ,B(3,3) ,C(3,3) 

2920  Wait=100  !    5359A  settling  delay 

2940  Printer=16 

2960  LINPUT   "Printer  select   code?   (Default   is   16.)",Resp$ 

2980  IF   Resp$=""   THEN  3020 

3000  Printer=VAL(TRIM$(Resp$)) 

3020  PRINTER   IS   Printer 

3040  LINPUT   "What   is  the  msus  where  the  data  and  program  are  stored?", Msus_data$ 

3060  Msus_data$=TRIM$(UPC$(Msus_data$)) 

3080  IF  Msus  data$[l,l]<>":"  THEN  Msus_data$=" : "&Msus_data$ 

3081  IF  DiskTo""  THEN  3100 

3082  LINK  "DTG"&Msus_data$, 32000 

3083  GOSUB   Disk_dtg 

3100  No_samples=1024  !  This  is  fixed,  in  this  program. 

3120  INPUT  "Nominal  bearing  angle  (degrees)?" ,Nom_bearing 

3140  Housekeeping(2)=Nom_bearing 

3160  INPUT  "Process  old  data  (1),  or  take  new  data  (2)?"  ,01d_data 

3180  IF  (Old  dataol)  AND  (01d_data<>2)  AND  (01d_data<>0)  THEN  3160 

3200  IF  01d_Jata=0  THEN  End 

3220  IF  01d_data=l  THEN  GOSUB  Retrieve_data 

3240  IF  01d_data=l  THEN  End 

3241  IF  LEN(Year$)=2  THEN  3260 

3242  INPUT  "Last  two  digits  of  the  present  year?",Year$ 

3243  IF  LEN(Year$)<>2  THEN  3242 

3260  INPUT  "Number  of  measurements?" ,No_measmnts  !  Loop  for  statistics. 

3280  IF  (No_measmnts<l)  OR  (No_measmnts>100)  THEN  3260 

3300  Storing=0  !   A  flag   for  Check_files 

3320  GOSUB  Check_files 

3340  FOR  Measmnt=l  TO  Nojneasmnts 

3360     Measurement=Measmnt 

3380     No_overloads=0  !  No_overloads  counts  bad  data  points. 

3400     GOSUB  Setup_5359  !  Resset  5359A  for  every  Measmnt. 

3420     GOSUB  Take_data 

3440     GOSUB  Store_data 

3460  NEXT  Measmnt 

3480  PRINTER  IS  16 

3500  PRINT  PAGE 

3520  PRINT  "Data  acquisition  is  complete.  All  data  in  this  set  of  measurements  have  been" 

3540  PRINT  "stored.  Processing  is  in  progress." 

3560  File_no=VAL(File$[4,6])-No_measmnts+l  !  If  data  has  just  been  taken, 

3580  !  this  resets  the  File_no  to  the 

3600  !  first  file  in  the  set,  for 

3620  !  processing. 

3640  PRINTER  IS  Printer 

3660  GOSUB  Retrieve_data  !  Retrieves  and  processes  the  data; 

3680  !  prints  out  results  and  stats. 

3700  End:! 

3720  PRINT  LIN(2) 

3740  PRINTER  IS  16 

3750  STOP! 

3780  Setup_5359:! 

3800  REMOTE  716 

3820  Delay$="W200E-9,OA5,000,DSS" 

3840  FLOAT  11 

3860  Del ay$=Del ay$&VAL$( 1/ ( 30*No_sampl es ) )&" ,TPONSP  ,D0 , " 

3880  STANDARD 

3900  OUTPUT  716;Delay$ 

3920  RETURN  ! 

3940  Take_data:! 

3960  GOSUB  Time 

3980  PRINT  "Data  taking  began  at  ";Time$ 

4000  PRINT  "Code  dtg:  ";Rev$;".  Disk  dtg:  ";Disk$;".  Filename:  ";Filename$ 

4020  MAT  Integer_data=ZER 

4040  OUTPUT  716;Delay$  !  Reset  5359A  for  each  measurement. 
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4060  FOR  Counter=l  TO  No_samples 

4080  OUTPUT  716;"SCRA,"          !  Single-Cycle,  Re-Arm 

4100  WAIT  Wait                !  Wait=settl i ng  delay  for  5359A. 

4120  Sample=READBIN(2) 

4140  IF  ABS(Sample)<32767  THEN  4240    !  Test  for  overload. 

4160  BEEP 

4180  DISP  "" 

4200  DISP  "  OVERLOAD!  " 

4220  No_overloads=No_overloads+l 

4240  Integer_data{Counter,l)=Sainple 

4260  OUTPUT  716;"DSU,"                          !    Delay   Step   Up 

4280  NEXT  Counter 

4300  RETURN    ! 

4320  Statistics:  ! 

4340  PRINT  "Code  dtg:  ";Rev$;".  Disk  dtg:  ";Disk$;".  Filename:  ";Filename$ 

4360  REDIM  Stats(No_measmnts ,1) 

4380  IF  No_measmnts=l  THEN  4860     !  If  there  has  been  only  one  meas- 

4400  !  urement,  statistics  are  skipped. 

4420  MAT  Stats=Results 

4440  IF  Nom_bearing<>0  THEN  4520 

4460  FOR  Counter=l  TO  No_measmnts   !  Allows  stats  near  0.00  degrees. 

4480  IF  Stats(Counter,l)>350  THEN  Stats (Counter, l)  =  -(360-Stats (Counter, 1) ) 

4500  NEXT  Counter 

4520  Mean=SUM(Stats )/No_measmnts    !  Stats(*)  now  contains  all  the 

4540  !  measurement  results. 

4560  MAT  Stats=Stats-(Mean) 

4580  MAT   Stats=Stats. Stats                      !    Square   each   element   in   Stats(*). 

4600  Variance=SUM( Stats )/(No_measmnts-l) 

4620  Std_dev=SQR( Variance) 

4640  PRINT 

4560  IMAGE  "Mean : " ,21( " ." ) ,M3D.3DX3D, "  degrees" 

4680  PRINT  USING  4660;Mean 

4700  IMAGE  "Nominal  beari ng" ,11( " . " ) ,4D.2D 

4720  PRINT  USING  4700;Nom  bearing 

4740  IMAGE  "Vari ance: " ,17T" . ") ,2X,M1D.3DE 

4760  PRINT  USING  4740;Vari ance 

4730  IMAGE  "Standard  devi ati on : " ,7( " . " ) ,2X,M1D.3DE, "  degrees" 

4800  PRINT  USING  4780;Std_dev 

4820  IMAGE  "Mean  minus  nomi nal : " ,7( " . " ) ,M3D.3DX3D,"  degrees",/ 

4840  PRINT  USING  4820;Mean-Nom_bearing 

4860  RETURN  ! 

4880  Time:   ! 

4900  OUTPUT  9;"R" 

4920  ENTER   9;Time$ 

4940  Time$=Year$&":"&Time$ 

4960  Time_noS=Time$[l,2]^Time$[4,5]&Time$[7,8]&Time$[10,ll]&TimeS[13,14]&Time$[16,17] 

4980  Time_no=VAL(Time_noS)                      !    Used   for  Housekeepi ng(*)    info.,   and 

5000  RETURN    !                                             1   elsewhere. 

5020  Store_data:        ! 

5040  Storing=l 

5060  GOSUB  Check_files 

5080  GOSUB  Housekeeping! 

5100  IF   File_no<10  THEN   Fi le$="DAT00"&VAL$(Fi le_no)&Msus_data$ 

5120  IF   File_no>=10  THEN  Fi le$="DATO"&VAL$(Fi le_no)&Msus_data$ 

5140  IF   File_no=100   THEN   Fi leS="DAT"&VAL$(Fil  e_no)&Msus_data$ 

5160  CREATE   File$,17,256                          !    For   Integer_data(*)   S  Housekeepi ng(*) . 

5180  ASSIGN  #1   TO   File$ 

5200  MAT   PRINT  #1 ;  Integer_data, Housekeepi ng 

5220  ASSIGN  *  TO  #1 

5240  GOSUB   Time 

5260  PRINT   "Data   stored   in   file    ";File$;",   disk   ";Disk$;",    at    "  ;Time$;" ." ,LIN( 1) 

5280  RETURN    ! 


5300   Petri eve_data: 

5320 

5340 


Gets   data   files,    processes   them, 
and   prints   results. 
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5360  IF  01d_data<>l  THEN  5420      !  Jumps  if  processing  data  just  taken. 

5380  INPUT  "Data  files  are  'DAT'  followed  by  a  number.  What's  the  no.  of  the  first  file?"  ,File_no 

5400  INPUT  "How  many  measurements  were  in  the  set?" ,No_measmnts 

5420  REDIM  Results (No_iTieasmnts,l) 

5440  Result_no=0 

5460  IF  Xt(l,l)=l  THEN  5540        !  IF. ..THEN  Xt{*)  is  in  COMmon  memory. 

5480  ASSIGN  #1  TO  "Xt    "&Msus  data$ 

5500  READ  #1 ;Xt(*) ,JnT*77Pointer(*) ,Ck 

5520  ASSIGN  *  TO  #1 

5540  FOR  File=File_no  TO  Fi  le_no+No_measmnts-l 

5560  Processed=0              !  (Set  to  1  when  the  file  is  processed.) 

5580  Result_no=Result_no+l 

5600  IF  File<10  THEN  Fi le$="DATOO" 

5620  IF  File>=10  THEN  File$="DATO" 

5640  IF  File=100  THEN  File$="DAT" 

5660  File$=File$&VAL$(File)AMsus_data$ 

5680  PRINTER  IS  16 

5700  PRINT  File$              !  Shows  the  progress  in  the  processing. 

5720  ASSIGN  #1  TO  File$ 

5740  ChangeZ:                    !  To  process  simulated  data,  READ  only 

5760  !  Real_data. 

5780  MAT  READ  #1 ;Real_data,Housekeepi ng 

5800  ASSIGN  *  TO  #1 

5820  Processed=Housekeeping(14) 

5840  IF  NOT  Processed  THEN  6180   !  Data  has  not  been  processed  before. 

5860  BEEP 

5880  PRINT  "File  "&File$&"  has  already  been  processed."; 

5900  IF  Housekeeping(15)  THEN  PRINT  "  It  is  a  bad  file."; 

5901  INPUT  "Do  you  wish  to  reprocess  it?  (1  or  0)", Reprocess 
5920  PRINT 

5940  PRINTER  IS  Printer 

5960  Results (Result_no,l)=Housekeeping(9) 

5980  Sigmasq=Housekeeping(12) 

6000  Est_std_dev=Housekeeping{13) 

6020  IF  File<>File_no  THEN  6100 

6040  IMAGE  "Data  fi le"  ,5X,"Beari ng  angle" ,5X,"Sigmasq" ,5X, "Est.  std.  dev." 

6060  PRINT  USING  6040 

6080  IMAGE  #,2X,6A,8X,4D.4D,6X,D.3DE,6X,D.3DE 

6100  IF  Est_std_dev>=lE-2  THEN  PRINT  CHR$(132); 

6120  PRINT  USING  6080;Fi le$,Housekeepi ng(9) ,Sigmasq,Est  std_dev 

6140  IF  Est_std_dev>=lE-2  THEN  PRINT  CHR$(248) ;"P0SSIBLr  BAD  DATA" 

6160  PRINT  CHR$(128) 

6180  IF  Housekeeping(3)=No_measmnts  THEN  6260         !  Test  No_measmnts. 

6200  BEEP 

6220  IMAGE  "The  data  file  just  loaded  shows  that  there  were  ",K,"  measurements  in  the 

set,",/, "not  ",K,".",/ 

6240  PRINT  USING  6220;Housekeepi ng(3) ,No_measmnts 

6260  IF  Housekeeping(8)=File  THEN  6400  !  Test  file  identification  for  con- 

6280  BEEP                        !  sistency,  to  avoid  false  results. 

6300  IMAGE  "Data  in  the  last  file  loaded  show  that  the  file  number  is  ",K,"  rather  than  ",K,".",/ 

6320  PRINT  USING  6300;Housekeeping(8) ,Fi le 

6340  Change3:                    !  To  process  simulated  data,  delete  the 

6360  !  following  line: 

6380  PAUSE                   !  There  is  a  file  error. 

6400  PRINTER  IS  Printer 

6420  IF  Processed  AND  NOT  Reprocess  THEN  GOTO  Next_file 

6440  MAT  Real_data=(5/32768)*Real_data  !  Convert  to  volts. 

6460  GOSUB  Fft_driver 

6480  GOSUB  Estimation 

6500  Processed=l              !  Data  now  processed. 

6520  GOSUB  Housekeepi ng2         !  Update  the  array. 

6540  ASSIGN  #1  TO  File$ 

5560  MAT  PRINT  #1,17 ;Housekeeping  !  Update  the  Housekeepi ng(*)  file. 

6580  ASSIGN  *  TO  #1 

6600  Results(Result_no,l)=Theta(l,l) 

6620  Signflag=0               !  Used  for  diagnostics. 

6640  Next_file:     ! 

6660  NEXT  File 

6680  IF  No_measmnts=l  THEN  6720     !  Don't  do  stats  if  only  1  measmnt. 
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6700 


GOSUB  Statistics 


6720 

6740  Che 

6760 

6780 

6800 

6820 

6840 

6860 

6880 

6900 

6920 

6940 

6960 

6980 

7000 

7020 

7040 

7060 

7080 

7100 

7120 

7140 

7160 

7180 

be  writt 

7200 

7220 

7240 

7260 

7280 

7300 


RETURN  ! 
ck  fi les  :  ! 


^Data  acquisition' 


!  Are  there  enough  files  left,  and 
!  when  Storing,  what's  the  next  no? 
DIM  CatS(100)[41] 
Skip=Return=0 

CAT  TO  Cat$(*),Skip,Return;"DAT"iMsus_data$,l 
IF  Cat$(l)<>""  THEN  6900 
Fi le_no=l 
GOTO  7300 
FOR  File  no=l  TO  100 

IF   POSTCat$(File_no),"DAT")=0  THEN  6980 

IF    VAL(Cat$(File_no)[4,6])=100   THEN   7140 
NEXT   File_no 

IF   Storing  THEN  7300  !    File   adequacy   has    been   checked,   by   now. 

IF   File_no-1+No_measmnts<=100  THEN   7300 
BEEP 

IF    100-File_no+l=0   THEN   7140 

PRINT   "There   are   " ;100-Fi  le_no+l; "files   remaining  on  this   disk.     Either   re-RUN  and   reduce" 
PRINT   "the   number  of  measurements,   or  use  a   new  disk  and  CONTinue.     All    of  the" 
PRINT   "measurements   in   a  set   should   be   on  the  same  disk,   however." 
GOTO  7280 

PRINT   "The   highest-numbered   data   file   on   this   disk   is   DAT_100.     To  store  any   new  data," 
PRINT   "some   of  these  data   files  must   be  purged,   using  the  program  PURDAT.      It  will" 
PRINT   "purge  all    data  files   at   and  beyond  a  specified  file  number." ,LIN(2) , "New  files   cannot 
en  with   numbers   lower  than   files   already  on  the" 
PRINT   "disk.     Attempting  to  do   so  will    result   in   a  STOP." ,LIN(1) 

PRINT   "If   files   are   deleted,   they   should   be   deleted   in   complete   sets,   if  possible,   to   " 
PRINT   "avoid  the   chance  of  processing  only  part   of  a  set  at   a  later  date." 
STOP 
PAUSE 
RETURN    ! 


7320 
7340 
7360 
7380 
7400 
7420 
7440 
7460 
7480 
7500 
7520 
7540 
7560 
7580 
7600 
7620 
7640 
7660 
7680 
7700 
7720 
7740 
7760 
7780 
7800 
7820 
7840 
7860 
7880 
7900 
7920 
7940 
7960 
7980 
8000 


Fft  driver:    !    (Data   processing; 


MAT  Meas=ZER 
Counter=0 

FOR    1=1   TO    No   samples/2 


Counter=Counter+l 

R(I)=Real_data(Counter,l) 

Counter=Counter+l 

I( I )=Real_data( Counter, 1) 
NEXT   I 
GOSUB   Fft 
Markerl:        ! 

FOR  Counter=l   TO  38 

Meas{Counter,l)=R(Pointer(C 
Changel : 

Meas(Counter,2)=-I(Pointer( 
Meas( Counter, 7 )=Pointer(Cou 

NEXT  Counter 

Meas(39,l)=R(l) 

Meas(39,2)=I(l) 

REDIM  Jn(-18:18) 

FOR  Row=2   TO   38 


Prepare   R(*)    &   I(*)    for   Fft:. 
(Fft:    is   from  the  hp  9835A  Numerical 
Analysis   package.     This   driver  creates 
Meas(*)   &  Q(*)   for  use   by   Estimation 
and  Diagnostic.) 


!    This    loop   needs   only   4  sec.   and   retains 
!   the  original    data  in  one  array.      It's 
!   worth   the  memory. 

!    Odd   rows   of   Data(*)    go   in   R(*). 

!  Even  rows  of  Data(*)  go  in  I(*). 

!  Do  the  transform. 


ounter) ) 

!   To  process   simulated  data,    remove  the 
!   minus   sign    (if  any)   in  the  next   line. 

Counter) ) 
nter)-l 

!    DC  term 

!   Max.   frequency   term 


Correct   the   signs   of   real    &  imag. 
components   of  the   spectral    lines. 
Pointer(Row)-l=harmonic  #. 
Jn(Row-20)=Bessel    function   for 
the   kth   sideband  away   from  9960 
Hz    (k   runs   from  -18  to   18). 


Meas ( Row , 6 ) =SGN ( Jn ( Row-20 ) ) 
Meas(Row,l)=Meas(Row,l)*Meas(Row,6; 


A-6 


8020 
8040 
8060 
8080 
8100 
8120 
8140 
8160 
8180 
8200 
8220 
8240 
8260 
8280 
8300 
8320 
8340 
8360 
8380 
8400 
8420 
8440 
8460 
8480 
8500 
8520 
8540 
8560 
8580 
8600 
8620 
8640 
8660 
8680 
8700 
872U 
8740 
8760 
8780 
8800 
8820 
8840 
8860 
8880 
8900 
8920 
8940 
8960 
8980 
9000 
9020 
9040 
9060 
9080 
9100 
9120 
9140 
9160 
9180 
9200 
9220 
9240 
9260 
9280 
9300 
9320 
9340 
9360 
9380 


Meas(Row,2)=Meas{Row,2)*Meas(Row,6) 
NEXT  Row 
DEFAULT  ON 
FOR  Row=l  TO  38 

!  Magnitude 

Meas(Row,3)=SQR(Meas(Row,l)'^2+Meas(Row,2)^2) 

!  Phase 

A=Meas(Row,l) 

B=Meas(Row,2) 

IF  A>0  THEN  Phase=ATN(B/A) 

IF  (A<0)  AND  (B<0)  THEN  Phase=ATN(B/A)-PI 

IF  (A<0)  AND  (B>=0)  THEN  Phase=ATN(B/A)+PI 

IF  (A=0)  AND  (B<0)  THEN  Phase=-PI/2 

IF  (A=0)  AND  (B>0)  THEN  Phase=PI/2 

Meas(Row,4)=Qr(Row,l)=Phase    !  This  is  in  radians,  unordered. 

Meas(Row,5)=Meas(Row,4)*180/PI  !  This  is  in  degrees,  unordered  here. 


IF  Meas(Row,5)<0  THEN  Meas{Row,5)=Meas(Row,5)+360 


Place  phase 
angles   in  0  to 
360  degrees. 


NEXT  Row 
0rdered=0 

Check=(ABS(Meas(21,5)-Meas(20,5))+ABS(Meas(20,5)-Meas(19,5)))*.5 
!    Don't   order  the  phase  angles   of  the   lines   if  not   necessary: 
IF   (Meas(20,5)+18*Checl«180)   AND   (Meas(20,5)-18*Check>-180)   THEN   10180 
Order_lines:  !    Put  phase  angles   for  sidebands  -7 

Ordered=l  !   through   7  in   sequence: 

Sidebands  -7  through  7  have  a   large  signal-to-noise   ratio. 
This   routine  fits   a  straight   line  to  the  ordered  phase  angles   for  side- 
bands  -7  through  7.      It  extrapolates   phase  angles  to  sidebands   -18 
through   18,   to  be  used  for  ordering  lines   outside  the  original    inter- 
val.    Then,   if  an  angle  must  be  changed,    it   is   incremented   (up,   if 
the  sideband  no.   is   +,   down  if  -)   by   360  degrees.     This   continues 
until    the  phase  angle  and   its   last  value  have  bracketed  the  value 
extrapolated.     A  comparison   is  then  made  of   between    (the  original    and 
extrapolated   values),   and   (the  incremented  and  the  extrapolated 
values).     The  closer  is   the  correct   phase  angle. 

Note  that  only  the  measured  data   is   used   in  the  estimation  of  the 
bearing  angle.     The  fitting  and  extrapolation  process   is  used  only 
to  determine  the  correct   number  of  multiples   of  360  degrees   to  be 
added  to  or  subtracted  from  the  phase  angles  of  the  sidebands.     The 
fitted   values   are  not  used   in  any  other  way;   they   help  prevent   order- 
ing errors  when  a   line's   signal-to-noise   ratio  is   low,   as   for   lines 
+8  and   -8. 
FOR  Row=21   TO  27  !   Order   lines   1  through   7. 

IF   Meas(Row,5)>Meas(Row-l,5)   THEN  8980 
Meas ( Row , 5 ) =Meas ( Row , 5 ) +360 


GOTO  8920 
NEXT   Row 
FOR   Row=19   TO   13   STEP   -1 

IF  Meas(Row,5)<Meas(Row+l,5] 

Meas(Row,5)=Meas(Row,5)-360 

GOTO  9020 
NEXT  Row 

REDIM  X(-7:7),Y(-7:7) 
PLOTTER  IS  13, "GRAPHICS" 
FOR  Row=-7  TO  7 

X(Row)=Row 

Y(Row)=Meas(Row+20,5) 
NEXT  Row 
GOSUB   Plot_data 
MAT   Xsq=X.X 
MAT   Ysq=Y.Y 
MAT   Xy=X.Y 
Mean_y=SUM(Y)/15 
Slope=SUM(Xy)/280 


!  Order  lines 
THEN  9080 


-1  through  -7. 


!  Set  up  X  and  Y  arrays  to  do  a  linear 
!  regression  on  the  15  lines. 

For  diagnostic  use. 

Squares  of  the  sideband  numbers 

Squares  of  the  phase  angles 

Products  of  (sideband  times  phase) 

Mean  phase 

Slope  of  best-fit  straight  line 


Totalss=SUM(Ysq)-SUM(Y)*SUM(Y)/15  !  Total  sum  of  squares 


Regss=SUM(Xy)*SUM(Xy)/280 
Resss=Regms=Totalss-Regss 


!  Regression  sum  of  squares 
!  Residual  sum  of  squares 
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9400 

9420 

9440 

9460 

9480 

9500  ! 

9520 

9540 

9560 

9580 

9600 

9620 

9640 

9660 

9680 

9700 

9720 

9740 

9760 

9780 

9800 

9820 

9840 

9860 

9880 

9900 

9920 

9940 

9950 

9980 

10000 

10020 

10040 

10060 

10080 

10100 

10120 

10140 

10160 

10180 

10200 

10220 

10240 

10260 

10280 

10300 


Resms=Resss/13 
REDIM  Y(-18:18) 
FOR  Row=-18  TO  18 

Y(Row)=Mean_y+Slope*Row 
NEXT  Row 

GOSUB  Plot_curve 
FOR  Row=28  TO  38 


IF  Meas(Row,5)>=Y(Row-20 

Value=Meas(Row,5) 

Meas(Row,5)=Meas(Row,5)+360 

IF  Meas(Row,5)>Y(Row-20 

\/alue=Meas(Row,5) 

Meas(Row,5)=Meas(Row,5)+360 

GOTO  9620 


Residual  mean  square 
Expand  Y(*)  to  accept  extrapolation. 
Compute  Y(*)  using  fitted  line.  None 
of  these  values  are  substituted  into 
Meas(*);  they  are  used  for  ordering. 
For  diagnostic  use. 
Order  lines  8  through  18;  Row=row  in 
Meas(*). 
THEN  9840  !  Row-20=sideband  number. 
!  Save  Meas(Row,5)  for  comparison. 
Add  the  first  360  degrees  and  test. 
THEN  9740   !  Y(sideband)  has  been  bracketed, 
!  Reset  Value, 


Add  another  360  degrees  until  Y(side- 
!  band)  has  been  bracketed.  Then  pick 
!  the  closer  value. 

Distancel=A6S(Value-Y(Row-20))      !  Test  the  previous  value. 

Distance2=ABS(Meas(Row,5)-Y(Row-20))  !  Test  the  current  value. 

Test=MIN(Di stancel ,Distance2)       !  Select  the  closer  of  the  two. 

IF  Test=Distancel  THEN  Meas(Row,5)=Value 

IF  Test=Distance2  THEN  Meas (Row,5)=Meas(Row,5) 
NEXT  Row 
FOR  Row=12  TO  2  STEP  -1       !  Order  lines  -8  through  -18: 

IF  Meas(Row,5)<=Y(Row-20)  THEN  10160 

Value=Meas(Row,5) 

Meas(Row,5)=Meas(Row,5)-360  !  Subtract  the  first  360  degrees. 

IF  Meas(Row,5)<Y(Row-20)  THEN  10060 

Value=Meas(Row,5; 


Meas (Row, 5; 
GOTO  9940 


=Meas(Row,5)-360 


Repeat  subtracting  360  degrees  until 
Y(Row-20)  has  been  bracketed,  then  pick 
the  closer  value. 


Distancel=ABS(Value-Y(Row-20)) 

Distance2=ABS(Meas(Row,5)-Y(Row-20)) 

Test=MIN(Di stancel, Distance2) 

IF  Test=Distancel  THEN  Meas (Row, 5)=Val ue 

IF  Test=Distance2  THEN  Meas(Row,5)=Meas(Row,5 

NEXT  Row 

DEFAULT  OFF 

FOR  Row=l  TO  38 

Qd(Row,l)=Meas(Row,5) 


NEXT  Row 
RETURN  ! 


Q(*)  in  degrees  (since  ordered' 
Eventually,  order  Meas(*,4), 
and  convert  Theta(*)  to  deg. 


10320 
10340 
10360 
10380 
10400 
10420 
10440 
10460 
10480 
10500 
10520 
10540 
10560 
10580 
10600 
10620 
10640 
10660 
10680 
10700 
10720 
10740 


Fft: 

K=0 

FOR  J=l 
1=2 
IF  K< 


TO  No  samples/2-1 


o_samples/(2*r 

K=K-No_samples/(2*I) 

1=1+1 

GOTO  10400 

K=K+No_samples/(2*I) 

IF  K<=J  THEN  10640 

A=R(J+1) 

R(J+1)=R(K+1) 

R(K+1)=A 

A=I(J+1) 

I(J+1)=I(K+1) 

I(K+1)=A 
NEXT  J 
G=.5 
P=l 
FOR  1=1  TO  10-1 

G=G+G 


THEN  10480 


The  "10"  is  the  power  of  2  equal  to 
No  samples.  See  hp  original. 
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10760 

C=l 

10780 

E=0 

10800 

Q=SQR((l-P)/2) 

10820 

P=(l-2*(I=l))*SQR((l+P)/2) 

10840 

FOR  R=l  TO  G 

10860 

FOR  J=R  TO  No  samples/2  STEP  G+G 

10880 

K=J+G 

10900 

A=C*R(K)+E*I(K) 

10920 

B=E*R{K)-C*I(K) 

10940 

R(K)=R(J)-A 

10960 

I(K)=I(J)+B 

10980 

R(J)=R(J)+A 

11000 

I(J)=I(J)-B 

11020 

NEXT  J 

11040 

A=E*P+C*Q 

11060 

C=C*P-E*Q 

11080 

E=A 

11100 

NEXT  R 

11120 

NEXT  I 

11140 

A=2*PI/No  samples 

11160 

P=COS(A) 

11180 

Q=SIN(A) 

11200 

A=R(1) 

11220 

R(1)=A+I(1) 

11240 

I(1)=A-I(1) 

11260 

R(l)=R(l)/2 

11280 

I(l)=I(l)/2 

11300 

C=l 

11320 

E=0 

11340 

FOR  J=2  TO  No  samples/4 

11360 

A=E*P+C*Q 

11380 

C=C*P-E*Q 

11400 

E=A 

11420 

K=No  samples/2-J+2 

11440 

A=R(J)+R{K) 

11460 

B=(I(J)+I{K))*C-(R(J)-R{K))*E 

11480 

U=I(J)-I(K) 

11500 

V={I(J)+I(K))*E+(R(J)-R(K))*C 

11520 

R(J)=(A+B)/2 

11540 

I(J)=(U-V)/2 

11560 

R(K)=(A-B)/2 

11580 

I(K)=-(U+V)/2 

11600 

NEXT  J 

11620 

I(No  samples/4+l)=-I(No  samples/4+1) 

11640 

MAT  R=R/(No  samples/2) 

11660 

MAT  I=I/(No  samples/2) 

11680 

RETURN  ! 

11700  Estimation: ! 

11720  Bad_file=0 

11740  MAT  Theta=Xt*Qd 

11760  MAT  Qr=(180/PI)*Qr           !  Convert  to  degrees, 

11780  IF  Theta(l,l)<0  THEN  Theta(l ,l)=Theta(l ,l)+360 

11800  Thetal_2=Theta(l,l)+Theta(2,l) 

11820  IF  Thetal_2>180  THEN  Thetal_2=Thetal_2-360 

11840  IF  Thetal_2>180  THEN  11820     !  Iterate  if  needed. 

11860  IF  Thetal_2<=-180  THEN  Thetal_2=Thetal_2+360 

11880  IF  Thetal_2<=-180  THEN  11860   !  Iterate  if  needed. 

11900  REDIM  Jn(-18:18) 

11920  Sum=(Qr(l,l)-Thetal_2)^2 

11940  FOR  1=314  TO  350 

11960  J=I-332                  !  J=sideband  number. 

11980  K=I-312                  !  K=harmonic  number. 

12000  Theta2_3=Theta(3,l)+J*Theta(2,l) 

12020  IF  Theta2_3>180  THEN  Theta2_3=Theta2_3-360 

12040  IF  Theta2_3>180  THEN  12020 

12060  IF  Theta2_3<=-180  THEN  Theta2_3=Theta2_3+360 

12080  IF  Theta2_3<=-180  THEN  12060 

12100  Sum=Sum+Jn(ABS(J))^2*(Qr{K,l)-Theta2  3)  2 
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12120  NEXT   I 

12140  Sigmasq=No_samples*Suni/35  !    No_samples   is   fixed  at   1024,    in  this 

12160  !    program.     The  35   results   from  using 

12180  !    38  lines   in  this   estimate  and   3  degrees 

12200  !    of  freedom  when   estimating  Theta(*). 

12220  Var=(l+Ck)*Sigmasq/No_samples      !    Ck   came  from  file   "Xt ". 

12240  Est_std_dev=SQR(Var) 

12260  IF  File<>File_no  THEN  12320 

12280  IMAGE  "Data  file" ,5X, "Beari ng  angle" ,5X, "Si gmasq" ,5X, "Est.  std.  dev." 

12300  PRINT  USING  12280 

12320  imGE   #,2X,6A,8X,4D.4D,6X,D.3DE,6X,D.3DE 

12340  IF  Est_std_dev>=lE-2  THEN  PRINT  CHR$(132); 

12360  PRINT  USING  12320;Fi leS,Theta(l,l) ,Sigmasq,Est_std_dev 

12380  IF  Est_std_dev>=lE-2  THEN  PRINT  CHRS(248) ;"P0SSIBLE  BAD  DATA" 

12400  PRINT  CHR$(128) 

12420  IF  Est_std_dev>=lE-2  THEN  Bad_file=l 

12440  RETURN  ! 


The  routine  belov^  is  used  to  compute 

and  store  Xt(*)  in  file  "Xt ".     To 

use  this  code,  lable  Xt_dim:  must  be 
enabled.  In  most  cases,  it  is  simpler 

to  COPY  file  "Xt "   from  an  existing 

copy. 

Set  up  Pointer(*). 


12460  Xt: 

12480 

12500 

12520 

12540 

12560 

12580  Pointer(l)=2 

12600  FOR  Counter=2  TO  38 

12620  Pointer(Counter)=313+Counter 

12640  NEXT  Counter 

12560  REDIH  Jn(-18:18) 

12680  Jn(0)=-. 174899073984         !  Jn(0)  S  Jn(l)  are  used  in  the  following 

12700  Jn(l)=. 0903971756613         !  recursion  to  generate  Jn(-18)  through 

12720  FOR  Counter=l  TO  18          !  Jn{18),  where  n=15. 

12740  IF  Counter=18  THEN  12780 

12760  Jn(Counter+l)=Counter/8*Jn( Counter )-Jn(Counter-l) 

12780  Jn( -Counter) =(-l)"Counter*Jn( Counter) 

12800  NEXT  Counter 

12820  Ck=0                      !  Compute  the  constant  Ck. 

12840  FOR  J=l  TO  18 

12860  Ck=Ck+J^2*Jn(J)-2 

12880  NEXT  J 

12900  Ck=l/(2*Ck) 

12920  REDIM  Jn(l:37) 

12940  MAT  X=ZER                  !  Compute  Xt(*). 

12960  MAT  V=ZER 

12980  X(1,1)=X(1,2)=1 

13000  V(l,l)=l 

13020  FOR  Row=2  TO  38 

13040  X(Row,2)=Row-20 

13060  X(Row,3)=l 

13080  V(Row,Row)=l/(Jn(Row-l)*Jn(Row-l)) 

13100  NEXT  Row 

13120  MAT  V=V*(2/No_samples) 

13140  MAT  Xt=TRN(X) 

13160  MAT  Vi=INV(V) 

13180  MAT  A=Vi*X 

13200  MAT  B=Xt*A 

13220  MAT  C=INV(B) 

13240  REDIM  A(3,38)               !  Re-use  MAT  A. 

13260  MAT  A=Xt*Vi 

13280  MAT  Xt=C*A                  !  Re-use  f-IAT  Xt. 

13300  ON  ERROR  GOSUB  13440 

13320   CREATE  "Xt ^^',1,3*38*8+37*8+38*8+8 

13340   ASSIGN  #1  TIT^Xt " 

13360  PRINT  #l,l;Xt(*),Jn(*), Pointer!*), Ck 

13380  ASSIGN  *  TO  #1 

13400  OFF  ERROR 

13420  END 

13440  IF  ERRN=54  THEN  RETURN 

13460  BEEP 
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13480  PRINT  ERRM$ 

1350U  STOP! 

13b20  Meds_print:                 !  Prints  Meas(*)  for  diagnostics. 

13640  PRINT  CHR$(27)&"8ilOT";        !  Supress  margins  on  perf.  paper. 

13560  PRINT  "Code  dtg:  ";Rev$;".  Disk  dtg:  ";Disk$;".  Filename:  ";Filename$ 

13580  PRINT  File$J4"  Nominal  bearing  angle-"  ;Housekeepi  ng(2)  ,LIN(  1) 

13600  IMAGE  "Corn" ,2X, "Real ", IX, "Corr" ,3X,"Imag" ,X, "Bess" ,3X," Line" ,6X,"Rad-" ,7X, "Deg- 

",3X,"Line",X,"Row",2X,"Row" 

13620  PRINT  USING  13600 

13640  IMAGE  "si gn" ,2X,"part" , lX,"si gn" ,3X,"part" ,X ,"si gn" ,3X, "ampl " ,6X, "i ans" ,7X, "rees" ,3X," 

no.",X,"  no.",X,"-20" 

13660  PRINT  USING  13640 

13680  PRINT 

13700  IMAGE  3D, 2D. 4D, IX, 30,  X,20.4D,X,30,X2D.4D,X5D,4D,X7D.2D,2X,4D,X,3D,2X,3D 

13720  FOR  Row=l  TO  39 

13740  IF  (Row<>39)  AND  (Rowol)  THEN  13800 

13760  S1=S2=J3=0 

13780  GOTO  13880 

13800  Sl=SGN(Jn(Row-20))*SGN(Meas(Row,l)) 

13820  S2=SGN(Jn(Row-20))*SGN(Meas(Row,2)) 

13840  J3-SGN(Jn(Row-20)) 

13860  IF  Signflag  THEN  S1=S2=0 

13880  PRINT  USING 

13700;Sl,Meas(Row,l),S2,Meas(Row,2),J3,Meas(Row,3),Meas(Row,4),Meas(Row,5),Meas(Row,7),Row,Row-20 

13900  IF  (Row=l)  OR  (Row=4)  OR  (Row=9)  OR  (Row=14)  OR  {Row=19)  OR  (Row=20)  OR  (Row=25)  OR  (Row=30) 

OR  (Row=35)  THEN  PRINT 

13920  NEXT  Row 

13940  Signflag=l                                          !    Prints   CSGN's   only  first   pass. 

13960  !   They  are  meaningless   after  that. 

13961  PRINT  "Theta(*):" 

13962  MAT  PRINT  Theta 

13980  PRINT  "&136T";             !  Restore  margins. 

14000  RETURN  ! 

14020  Plot:                      !  Used  for  diagnostics. 

14040  PRINT  "(410T";              !  Supress  auto  feed  at  perforations. 

14060  INPUT  "Do  you  want  a  GRAPHICS  dump?  (Y  or  N)",Dump$ 

14080  Dump$=UPC$(Dump$) 

14100  GCLEAR                    !  Kill  this  line  for  overlaid  plots. 

14120  LINE  TYPE  1 

14140  FRAME 

14160  GRAPHICS 

14180  Rmax=Dmax=-lE99 

14200  Rmin=Dmin=lE99 

14220  FOR  Row=2  TO  38 

14240  Rmax=MAX(Rmax,Meas(Row,4)) 

14260  Rmin=MIN{Rmin,Meas(Row,4)) 

14280  Dmax=MAX(Dmax,Meas(Row,5) ) 

14300  Dmin=MIN(Dmin,Meas(Row,5)) 

14320  NEXT  Row 

14340  SCALE  2,38,Rmin,Rmax 

14360  FOR  Row=2  TO  38 

14380  PLOT  Row,Meas(Row,4) 

14400  NEXT  Row 

14420  SCALE  2,38,Dmin,Dmax 

14440  MOVE  2,Meas(2,5) 

14460  LINE  TYPE  6 

14480  FOR  Row=2  TO  38 

14500  PLOT  Row,Meas(Row,5) 

14520  NEXT  Row 

14540  LINE  TYPE  3 

14560  MOVE  12,Dmin 

14580  DRAW  12,Dmax 

14600  MOVE  20,Dmax 

14620  DRAW  20,Dmin 

14640  MOVE  28,Dinin 

14660  DRAW  28,Dmax 

14680  IF  POS(Dump$,"Y")  THEN  Graph_pri nter=0 
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14700  IF   NOT   POS(Dump$,"Y")    THEN   Graph   printer=15 

14720  PRINTER    IS  Graph_pri nter 

14740  PRINT  File$,"Code   revision   dtg:";Rev$, 

14760  IF  Ordered  THEN  PRINT   "Ordered  angles." 

14780  IF   NOT  Ordered  THEN  PRINT   "Angles   not   ordered." 

14800  PRINT  "Rniin=",Rmin,"Rmax=",Rmax,LIN(l);"Dmin  =  ",Dmin,"Dinax=",Dmax 

14820  IF  Sigmasq  THEN  14880         !  False  values  for  the  variance  and 

14840  GOSUB  Estimation            !  est.  s.  d.  will  result  if  Estimation 

14860  !  has  already  be  done  once. 

14880  IF  P0S(Dump$,"Y")  THEN  DUMP  GRAPHICS 

14900  PRINTER  IS  Printer           !  Restore  printer  designation. 

14920  PRINT  "&136T";  !  Restore  margins  at  perforations. 

14921  EXIT  GRAPHICS 
14940  STOPlLpLp 
14960  Plot_curve: ! 
14980  GRAPHICS 
15000  FRAME 

15020  SCALE  -20,20,Meas(2,5) ,Meas(38,5) 

15040  AXES  1,10,0,0 

15060  MOVE  -18,Y(-18) 

15080  FOR  X=-18  TO  18 

15100  DRAW  X,Y(X) 

15120  NEXT  X 

15140  PENUP 

15160  LORG  1 

15180  CSIZE  3.3 

15200  MOVE  .5,-15 

15220  IMAGE  22A,D.DDE 

15240  LABEL  USING  15220 

15260  LABEL  USING  "5A,14X,4D.4D" ;"Mean=" ,Mean_y 

15280  LABEL  USING  "6A,13X,4D.4D" ;"Slope=" , Slope 

15300  LABEL  USING  15220;"Total  sum  of  sq.=" , Total ss 

15320  LABEL  USING  15220; "Regression  sum  of  sq.=",Regss 

15340  LABEL  USING  15220; "Residual  sum  of  sq.=",Resss 

15360  LABEL  USING  15220;"Residual  mean  sq.=",Resms 

15380  RETURN  ! 

15400  Plot_data:! 

15420  GRAPHICS 

15440  LORG  5 

15460  CSIZE  1.7 

15480  FOR  Row=-7  TO  7 

15500  MOVE  Row,Y(Row) 

15520  LABEL  USING  "2D";Row 

15540  NEXT  Row 

15560  PENUP 

15580  RETURN  ! 

15600  File_list:                   !  Checks  DAT  files  for  bearing  angle. 

15620  PRINT  "Code  dtg:  ";Rev$;".  Disk  dtg:  ";Disk$;".  Filename:  ";Filename$ 

15640  ON  ERROR  GOTO  15860 

15660  FOR  N=l  TO  100 

15680  IF  N<10  THEN  Fi 1 e$-"DATOO"^VAL${N) 

15700  IF  N>=10  THEN  Fi le$="DATO"&VAL$(N) 

15720  IF  N=100  THEN  Fi le$="DAT"&VAL$(N) 

15740  ASSIGN  #1  TO  FileS 

15760  MAT  READ  #1 ; Integer_data,Housekeepi ng 

15780  PRINT  FileS;":  Nominal  bearing  angle=" ;Housekeepi ng(2) 

15800  ASSIGN  *  TO  #1 

15820  NEXT  N 

15840  END 

15860  IF  ERRN=56  THEN  15940 

15880  PRINT  ERRM$ 

15900  OFF  ERROR 

15920  END 

15940  PRINT  FileS;"  not  yet  assigned." 

15960  OFF  ERROR 

15980  STOPlLpLp 

16000  Re_store:                    !  Called  by  key  20.  Assures  that  program 
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15020   RE-STORE  "VORl" 
16040   STOPlLpLp 


16240  Housekeepingl: 

16260   MAT  Housekeeping=ZER 

Housekeepi  ng( l)=Time_no 
Housekeeping(2)=Nom_bearing 
Housekeepi  ng( 3)=No_measmnts 
Housekeepi ng(4)=MedSurement 
Housekeepi ng( 5 )=No_overloads 
Housekeepi ng( 6 )=VAL(Rev$) 


16280 
16300 
16320 
16340 
16360 
16380 
16400 
16420 
16440 


Housekeeping! 7 )=VAL(Disk$) 
Housekeepi  ng(8)=Fi 1e_no 
RETURN  ! 


!   is  RE_ST0RE'd  in  the  file   identified  by 
!    Re_store:. 

!   Used  when   data   is   first   stored. 

Date-time-group  data  were  stored. 

Nominal    bearing  angle,   deg. 

Number  of  measurements   in  the  set. 

Number  of  this  measurement  in  the  set. 

Number  of  ADC  overloads. 

Program  revision  date-time-group. 

Disk   serial    number. 

Data  file  number   (1-100). 


16460  Housekeepi ng2: 

16480  Housekeeping(9)=Theta(l,l) 

16500  Housekeepi ng{ 10 )=Theta( 2,1) 

16520  Housekeepi ng( 11 )=Theta( 3,1) 

16540  Housekeeping(12)=Sigmasq 

16560  Housekeepi ng(13)=Est_std_dev 

16580  Housekeeping(14)=Processed 

16600  Housekeeping(15)=Bad_file 

16620  RETURN    ! 


Used  after  data   is   processed. 

Computed  bearing  angle. 

See  analysis. 

See  analysis. 

See  analysis. 

Estimated  s.   d.   for  a  large  set, 

If  =1,   data  has   been  processed. 

Flags   files  with  excessive  est. 


32000   Disk  dtg:! 

32010  DiskT="8204231411' 

32020  RETURN 
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Appendix  B.  Test-Data  Listings 

These  data  lists  are  abstracted  from  the  "housekeeping"  files  of  the  permanent  magnetic  records 
maintained  on  every  measurement.  The  result  from  the  processing  of  the  raw  data  taken  by  the  phase- 
meter  ADC.  Each  row  represents  a  single  measurement  of  1024  time  samples  at  a  given  bearing  angle. 
Each  block  of  five  rows  represents  (usually)  a  set  of  five  measurements  at  a  given  angle,  taken  over  a 
period  of  about  32.5  min. 


The  columns  present  the  following  information  for  each  measurement; 


1.  RUN  DTG: 


2.  BEARING: 


3.  SET: 

4.  NO.: 

5.  DISK  DTG: 


6.  FILE; 


7.  THETAl; 


8.  THETA2: 


9.  THETA3: 

10.  SIGMA  SQUARED: 

11.  ST.DEV.  THETAl 


This  is  a  10-digit  numerical  representation  of  the  date  and  time  in  the  form 
YYMMDOHHMM,  where  the  first  pair  of  digits  is  the  the  last  two  digits  of  the 
calendar  year,  the  next  two  give  the  month,  then  the  day,  hour,  and  minute. 
This  results  in  a  unique  number  that  identifies  every  measurement.  It  comes 
from  a  real-time  clock  in  the  measurement  computer. 

The  nominal  bearing  angle  set  on  the  front  panel  switches  of  the  standard 
generator.  The  number  is  not  used  in  the  estimation  of  the  bearing  angle, 
only  in  the  calculation  of  the  deviation  between  the  setting  and  Thetal ,  the 
measured  angle. 

The  number  of  measurements  in  the  set. 
The  number  of  the  measurement  in  the  set. 

This  is  another  date-time  group  having  the  same  interpretation  as  the  RUN 
DTG.  Is  is  recorded  on  the  disk  when  it  is  first  initialized,  and  becomes  a 
unique  serial  number  identification  for  that  disk.  It  is  recorded  in  every 
data  file  on  that  disk  and  allows  tracing  processed  results  back  to  the 
original  raw  data,  for  further  study. 

The  file  number  of  a  measurement.  It  ranges  from  001  to  100,  and  the  cor- 
responding data  file  names  are  DATOOl  to  DATIOO.  The  file  names  (and  num- 
bers) are  computed  automatically  by  the  software  and  allow  tracing  processed 
data  back  to  the  original  file. 

The  estimated  VOR  bearing  angle.  It  is  stored  as  a  full-precision  result, 
without  rounding. 

The  second  angle  measured  by  the  phasemeter.  See  the  equation  for  the  model 
for  interpretation.  It  is  a  result  that  is  not  directly  involved  in  the 
final  answer,  but  is  useful  for  detecting  certain  system  instabilities. 
Note  that  it  does  not  change  appreciably  from  measurement  to  measurement  or 
from  month  to  month. 
Similar  to  THETA2;  see  above. 

An  estimate  of  the  mean  square  error  in  the  voltage  measurements  in  a  single 
bearing  angle  measurement. 

An  estimate  of  the  standard  deviation  of  THETAl,  again  based  on  a  single 
measurement.   It  is  not  the  standard  deviation  for  the  set  of  measurements. 
Usually,  the  standard  deviation  for  the  set  is  one-third  to  one-tenth  this 
estimate,  which  is  therefore  conservative. 
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Appendix  C.  Graphical  Illustrations* 

The  purpose  of  this  attachment  is  to  illustrate  graphically  some  of  the  characteristics  of  the 
VOR  measurement  process  which  have  been  explored.  The  data  were  collected  to  help  answer  some  ques- 
tions which  are  often  at  the  core  of  an  examination  of  a  new  measurement  process,  for  example, 

1.  Are  there  warm-up  effects  which  affect  the  process? 

2.  What  is  the  systematic  error  in  an  estimated  value? 

3.  Are  there  within-day  or  day-to-day  differences  which  will  affect  the  results? 

4.  Is  the  bearing  measurement  system  linear? 

5.  What  is  the  best  procedure  for  monitor  the  process? 

The  answers  to  these  (and  other)  questions  are  the  components  of  the  final  documentation  of  the  sta- 
tistical properties  of  the  VOR  measurement  process.  Quality  control,  or  measurement  assurance,  pro- 
cedures follow  naturally  from  the  analysis. 

Data  which  are  shown  in  the  exhibits  were  collected  by  sound  statistical  practices  to  answer  one 
or  more  of  the  questions  listed  above.  Whenever  data  were  collected  at  several  bearing  angles,  switch 
settings  on  the  signal  generator  were  selected  at  random.  Various  quantities  which  are  plotted  are 
identified  by: 

1.  "Bias":    Nominal  bearing  minus  estimated  bearing; 

2.  Theta{l):  Estimated  bearing; 

3.  Bear  Std:  Estimated  standard  deviation  of  Theta(l);  used  to  flag  individual  outliers  (see 

ref.  3); 

4.  Theta(2):  Auxiliary  phase  angle  (see  ref.  3);  used  to  monitor  the  system; 

5.  Theta(3):  Auxiliary  phase  angle;  also  used  to  monitor  the  system. 


There  are  four  sets  of  graphs: 


Exhibit  C.l 

Exhibit  C.2 

Exhibit  C.3 

Exhibit  C.4 


Start-up  effects 

Within-day  effects 

Systematic  offset  from  nominal  bearing 

Systematic  offset,  5°  interval 


*The  NBS  statistical  software  package  STATLIB  was  used  to  obtain  plots  in  this 
appendix. 
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Exhibit   C.l 

Start-up   effects:      20  successive  measurements   at   a  fixed   nominal    bearing  were   collected   on   both  March 
8  and  March   10   (1982).     Each   run  began   from  a  cold-start  of  all    system  components  and  continued  for 

approximately   two   hours. 

Remarks:     Approximately   45  to  60  mi n   should  be  allowed  for  warm-up  of  the  system  before  performing 
calibrations.     Theta(3),   and   its   associated  DAC,    requires  the  most  time  to  stabilize. 
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Exhibit  C.2 

Mi  thin-day   effects:     45  successive  measurements   at   nominal    bearing   120°  were  collected  on  March  2, 
March   26,   and  March   31    (1982).     Each   run  began   from  a  warm-up   start   and   lasted  approximately  4  h,   40 
min. 

Remarks:     1.     Theta(l)   has   no  apparent  trend. 

2.  Theta(2)   exhibited  a  trend  on   3-26  and   3-31,   but   not  on   3-2. 

3.  Theta(3)   plots  depict   a  thermal    drift   in  the  associated  DAC  on   all    three  days.     Note, 
however,   that  the   range  of  Theta{3)   is  only  0.0074  on   3-2,   0.0128  on   3-25,   and  0.0115  on   3-31.     The 
effect  on  the  drift  will    be  negligible  if  Theta(3)    remains   relatively  stable  during  a  single  determi- 
nation of  Theta(l),   i.e.,   for  approximately  6  min. 
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Exhibit  C.3 

Systematic  offset  from  nominal  bearing:  The  275  measurements  from  the  first  4  occasions  used  to 
obtain  the  provisional  uncertainty  statement  for  the  VOR  calibration  service  are  useful  to  illustrate 
the  slight  offset  of  the  standard  phasemeter  measurements  from  the  nominal  bearing  of  the  standard 
signal  generator.  The  various  quantities  obtained  from  the  set  of  measurements,  excluding  outliers, 
is  plotted  versus  nominal  bearing.  There  are  five  groups  of  plots,  each  with  four  separate  graphs. 
The  first  group  shows  the  combined  data  from  the  four  measurement  occasions.  The  other  four  sets  of 
plots  show  each  occasion  separately,  as  labeled. 
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Exhibit  C.4 

Systematic  offset,  5°  Interval:  73  measurements  were  obtained  at  5°  bearing  intervals  on 

March  15,  1982.  Data  collection  began  at  8:15  a.m.  and  ended  at  2:30  p.m.  Measurements  at  the  73 

bearings  were  obtained  in  random  order.  Following  are  plots  of  the  "Bias,"  Theta(2)  and  Theta(3)  ver- 
sus the  nominal  bearing. 
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Appendix  D.  BMDP3V  Program  Listing 
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Appendix  E.  Sample  Report  of  Calibration 

The  results  of  a  calibration  are  reported  to  the  customer  using  a  form  letter  similar  to  that  in 

this  appendix.  There  are  a  number  of  different  phasemeter  designs  on  the  market,  so  there  is  some 

variation  in  the  way  the  test  is  conducted  and  the  results  reported.  If  the  phasemeter  is  designed  to 

permit  the  forcing  of  a  self-calibration  or  autozero,  this  is  done  before  every  observation.  Some 

instruments  have  provision  for  internal  digital  adjustment  by  means  of  switches.  Since  these  switches 

affect  the  calibration,  their  settings  are  recorded  on  the  data  sheet.  If  settings  have  been  changed 
since  the  last  calibration,  results  cannot  be  compared. 

The  data  sheet  carries  information  to  identify  the  customer,  the  instrument  (by  make,  model,  and 
serial  number),  and  other  useful  information.  It  shows  a  tabulation  of  the  raw  data,  the  standard 
deviation  for  each  bearing  angle,  and  difference  between  the  mean  and  nominal  for  each  angle.  The 
customer  can  then  correct  the  instrument  readings  using  the  table. 

The  data  are  taken  using  a  computer  program  named  "CALDAT".  This  program  allows  the  operator  to 
specify  the  number  of  bearing  angles,  the  number  of  readings  at  each,  and  all  of  the  housekeeping 
information  needed  to  document  the  measurement.  It  then  prompts  the  operator  as  to  the  setting  to  be 
made  on  the  NBS  generator.  When  the  phasemeier  under  test  achieves  a  stable  reading,  the  operator 
enters  it  into  the  computer.  In  order  to  minimize  drift  effects,  the  generator  settings  are 
randomized,  both  by  bearing  angle  and  by  the  reading  number  for  each  angle.  The  observed  readings  and 
the  housekeeping  data  are  stored  on  disc,  along  with  data  that  allows  unscrambling  the  order  of 
reading  in  a  case  a  future  time-trend  analysis  is  desired.  The  program  then  prints  out  the  data  sheet 
for  the  Report  of  Calibration. 
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UNITED  STATES  DEPARTMENT  OF  COMMERCE 
National  Bureau  of  Standards 

325  Broadway 

Boulder.  Colorado     80303 


Reply  to  the  attention  of: 

March  29,  1985 

Airframe  Manufacturing  Inc. 

1234  S.  Broadway 

Needles,  CA  99999 

ATTN:  Standards  Laboratory  Manager 

Dear  Si  r: 

Enclosed  is  a  copy  of  the  data  from  an  informal  calibration  of  your  VOR  Radial 
Standard,  (manufacturer  and  model),  Serial  No.  ,  NBS  Test  No.      . 

The  instrument  was  warmed  for  a  minimum  of  24  hours  before  calibration.  If  an 
autozero  function  was  provided  by  the  instrument,  it  was  forced  before  every 
observation.  If  present,  the  hexadecimal  number  displayed  during  the  autozero 
period  was  recorded  on  the  data  sheet. 

Four  observations  were  made  at  each  of  12  bearing  angles.  The  raw  data  and 
the  standard  deviations  for  each  bearing  angle  are  tabulated  on  the  attached 
data  sheet.  The  bearing  angles  for  the  set  of  48  observations  were  randomized 
to  reduce  the  effects  of  any  time  trends  and  interactions. 

Measurements  made  on  several  instruments  of  this  type  suggest  that  repeat- 
ability at  any  bearing  angle  is  about  ±0.01  degrees  immediately  after 
autozero. 

The  NBS  standard  VOR  generator  and  phasemeter  are  believed  to  have  a  combined 
systematic  and  random  uncertainty  of  less  than  ±0.0023  degrees  (95  percent 
confidence  level ) . 

Sincerely, 


Neil  T.  Larsen 

Microwave  Metrology  Group 

Electromagnetic  Technology  Division 
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NBS  TECHNICAL  PUBLICATIONS 


PERIODICALS 

JOURNAL  OF  RESEARCH— The  Journal  of  Research  of  the 
National  Bureau  of  Standards  reports  NBS  research  and  develop- 
ment in  those  disciplines  of  the  physical  and  engineering  sciences  in 
which  the  Bureau  is  active.  These  include  physics,  chemistry, 
engineering,  mathematics,  and  computer  sciences.  Papers  cover  a 
broad  range  of  subjects,  with  major  emphasis  on  measurement 
methodology  and  the  basic  technology  underlying  standardization. 
Also  included  from  time  to  lime  are  survey  articles  on  topics 
closely  related  to  the  Bureau's  technical  and  scientific  programs. 
As  a  special  service  to  subscribers  each  issue  contains  complete 
citations  to  all  recent  Bureau  publications  in  both  NBS  and  non- 
NBS  media,  issued  six  times  a  year.  Annual  subscription:  domestic 
$18;  foreign  $22.50.  Single  copy,  $5.50  domestic;  $6.90  foreign. 

NONPERIODICALS 

Monographs — Major  contributions  to  the  technical  literature  on 
various  subjects  related  to  the  Bureau's  scientific  and  technical  ac- 
tivities. 

Handbooks — Recommended  codes  of  engineering  and  industrial 
practice  (including  safely  codes)  developed  in  cooperation  with  in- 
terested industries,  professional  organizations,  and  regulatory 
bodies. 

Special  Publications — Include  proceedings  of  conferences  spon- 
sored by  NBS,  NBS  annual  reports,  and  other  special  publications 
appropriate  to  this  grouping  such  as  wall  charts,  pocket  cards,  and 
bibliographies 

Applied  Mathematics  Series — Mathematical  tables,  manuals,  and 
studies  of  special  interest  to  physicists,  engineers,  chemists, 
biologists,  mathematicians,  computer  programmers,  and  others 
engaged  in  scientific  and  technical  work. 

National  Standard  Reference  Data  Series — Provides  quantitative 
data  on  the  physical  and  chemical  properties  of  materials,  com- 
piled from  the  world's  literature  and  critically  evaluated. 
Developed  under  a  worldwide  program  coordinated  by  NBS  under 
the  authority  of  the  National  Standard  Daia  Act  (Public  Law 
90-396). 

NOTE:  The  principal  publication  outlei  for  the  foregoing  data  is 
the  Journal  of  Physical  and  Chemical  Reference  Data  (JPCRD) 
published  quarterly  for  NBS  by  the  American  Chemical  Society 
(ACS)  and  the  American  Institute  of  Physics  (AiP).  Subscriptions, 
reprints,  and  supplements  available  from  ACS,  1  155  Sixteenth  St., 
NW,  Washington,  DC  20056. 


Building  Science  Series — Disseminates  technical  irformation 
developed  at  the  Bureau  on  building  materials,  components, 
systems,  and  whole  structures.  The  series  presents  research  results, 
test  methods,  and  performance  criteria  related  to  the  structural  and 
environmental  functions  and  the  durability  and  safety  charac- 
teristics of  building  elements  and  systems. 

Technical  Notes — Studies  or  reports  which  are  complete  in  them- 
selves but  restrictive  in  their  treatment  of  a  subject.  Analogous  to 
monographs  but  not  so  comprehensive  in  scope  or  definitive  in 
treatment  of  the  subject  area.  Often  serve  as  a  vehicle  for  final 
reports  of  work  performed  at  NBS  under  the  sponsorship  of  other 
government  agencies. 

Voluntary  Product  Standards — Developed  under  procedures 
published  by  the  Department  of  Commerce  in  Part  10,  Title  15,  of 
the  Code  of  Federal  Regulations.  The  standards  establish 
nationally  recognized  requirements  for  products,  and  provide  all 
concerned  interests  with  a  basis  for  common  understanding  of  the 
characteristics  of  the  products.  NBS  administers  this  program  as  a 
supplement  to  the  activities  of  the  private  sector  standardizing 
organizations 

Consumer  information  Series— Practical  information,  based  on 
N  BS  research  and  experience,  covering  areas  of  interest  to  the  con- 
sumer. Easily  understandable  language  and  illustrations  provide 
useful  background  knowledge  for  shopping  in  today's  tech- 
nological marketplace. 

Order  the  above  NBS  publications  from:  Supermiendent  of  Docu- 
ments, Government  Priming  Office.   Washington.  DC  20402. 
Order  the  following  SBS  publications — FIPS  and  NBSIR's — from 
the  National  Technical  Information  Service .  Springfield,  VA  22161 . 

Federal  Information  Processing  Standards  Publications  (FIPS 
PUB) — Publications  in  this  series  collectively  constitute  the 
Federal  Information  Processing  Standards  Register.  The  Register 
serves  as  the  official  source  of  information  in  the  Federal  Govern- 
ment regarding  standards  issued  by  NBS  pursuant  to  the  Federal 
Property  and  Administrative  Services  Act  of  1949  as  amended. 
Public  Law  89-306  (79  Stat.  1127),  and  as  implemented  by  Ex- 
ecutive Order  11717(38  FR  12315,  dated  May  11,  1973)  and  Part  6 
of  Title  15  CFR  (Code  of  Federal  Regulations). 

NBS  Interagency  Reports  (NBSIR) — A  special  series  of  interim  or 
final  reports  on  work  performed  by  NBS  for  outside  sponsors 
(both  government  and  non-government),  in  general,  initial  dis- 
tribution is  handled  by  the  sponsor;  public  distribution  is  by  the 
National  Technical  information  Service  ,  Springfield,  VA  22161, 
in  paper  copy  or  microfiche  form. 
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